Home/ Questions/Q 948489
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-15T23:15:13+00:00

I’m trying to use a script to process a lot of dta records, let’s

  • 0

I’m trying to use a script to process a lot of dta records, let’s name it process.php, the problem is that I have a huge data set, to make the job done faster, I want to run multiple instances of this script with

/usr/bin/php process.php start_record end_record &

so I’ll have them running in parallel like

/usr/bin/php process.php 0 10000 &

/usr/bin/php process.php 10000 20000 &

/usr/bin/php process.php 20000 30000 &

/usr/bin/php process.php 30000 40000 &

…

I thought this way the job can be done much faster, but after trying I didn’t find it much faster, instead the speed seemed to be very close to the linear way(no concurrency). I don’t know if it’s because process.php is inserting record into a innodb table or what.

Any ideas.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    If you need to insert the rows into a database, it will make absolutely no difference. It’s the database that’s the bottleneck, not your PHP script. You can still only insert one row at a time, so each concurrent instance will just have to wait for each other.

    • 0