Question

I’m trying to get information from a site by parsing/scraping it via PHP & Curl. But sometimes the current page doesn’t finish loading, so the script runs without anything happening. It’s a simple script like this…

...

curl_setopt($curl, CURLOPT_URL, $url);

$page = curl_exec($curl);

...

Is there a way to simply retry the loading of the same page if the page doesn’t finish loading after (for example) 60 sec, without interrupting the complete script?

It would be great if someone could help me out with a way to realize this task.

Answer 1

You can use CURLOPT_TIMEOUT which is the maximum number of seconds to allow cURL functions to execute.

curl_setopt($ch, CURLOPT_TIMEOUT, timeout_in_seconds);