I’ve written a script in PHP that parses URLs for certain info, and echos that info to the web page. The problem is that it quits after about 200 URLs (I need ~200,000). No error messages or anything. What’s happening? Is there a timeout on the server side of things, or is it a browser issue? How should I work around this?
Share
Yes there is a PHP timeout and can be an Apache one too.
Best thing to do is run the script from the PHP CLI, that way it won’t time out.
Doing an operation on 200,000+ URL’s sounds like a bit too much. You should consider breaking them down into smaller jobs for performance and probably spam purposes too.