I have a script that is going to be run by via CRON every night and will take entries in one database and process them. I am curious what methods would be best to take so that I don’t use too much memory/error out or lag the server potentially. There could be anywhere up to maybe 6,000 entries that need to be processed…
I am curious on what methods should be used to mitigate the load being I am pretty sure just upping the memory limit could be inviting other issues once it passes a certain point. Thank you.
Use a database cursor and you don’t need to load everything into memory.
Assuming you’re using PDO, just do PDOStatement->fetch() for each item of the resultset.