Home/ Questions/Q 6114465
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-23T14:58:41+00:00

Background In one of our project, we need to run some massive task occasionally,

  • 0

Background

In one of our project, we need to run some massive task occasionally, e.g., generate reports, send numbers of notification emails. Sometimes it causes noticeable lag when such massive task is being run. So we are thinking of one possible solution.

Some thoughts

  1. Set crontab to run a backend script every 10 minutes.
  2. Collect the cpu usage info, I found http://phpsysinfo.sourceforge.net/phpsysinfo/index.php?disp=dynamic , but I’m not sure if there is a better way?
  3. If there are contiguous usage lower than a specific value, or the first task in the queue reaches its deadline, the script will get a certain number of tasks from the queue and run.

There are different types of massive task: e.g.,

  1. User can request certain type of report
  2. Notification emails
  3. Cleaning data in database
  4. …

I am wondering if this idea is worth trying?
Is there any problem, or is there some other better solution?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    This works up to a point but struggles if you are running anything where access is required 24 hours a day (like an internationally used site).

    You may wish to replicate your database and then run your heavy queries off of that – or investigate a form of data warehousing.

    What is a data warehouse?

    • 0