Home/ Questions/Q 7905043
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-03T10:18:25+00:00

I found out why this was happening, check my answer This is the only

  • 0

I found out why this was happening, check my answer

This is the only domain that this happens on, I’m running curl_multi on a bunch of URLs, this one comes back with 404 http_code http://www.breakingnews.com

But when I visit it in the browser it’s 200OK (takes a while to load) and doesn’t even look like a redirect.

Anyone know what’s up? Is this a common problem

here’s a var_dump:

 ["info"]=> array(22) { ["url"]=> string(27) "http://www.breakingnews.com" ["content_type"]=> string(24) "text/html; charset=utf-8" ["http_code"]=> int(404) ["header_size"]=> int(337) ["request_size"]=> int(128) ["filetime"]=> int(-1) ["ssl_verify_result"]=> int(0) ["redirect_count"]=> int(0) ["total_time"]=> float(1.152229) ["namelookup_time"]=> float(0.001261) ["connect_time"]=> float(0.020121) ["pretransfer_time"]=> float(0.020179) ["size_upload"]=> float(0) ["size_download"]=> float(9755) ["speed_download"]=> float(8466) ["speed_upload"]=> float(0) ["download_content_length"]=> float(-1) ["upload_content_length"]=> float(0) ["starttransfer_time"]=> float(1.133522) ["redirect_time"]=> float(0) ["certinfo"]=> array(0) { } ["redirect_url"]=> string(0) "" } ["error"]=> string(0) ""

UPDATE:
This actually looks like a php bug with curl_setopt($ch, CURLOPT_NOBODY, true);
https://bugs.php.net/bug.php?id=39611

EDIT: It’s not a bug.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I found the answer in a comment here http://w-shadow.com/blog/2007/08/02/how-to-check-if-page-exists-with-curl/comment-page-1/#comment-12186
    By setting CURLOPT_NOBODY to true, CURL will use HEAD for the request, which some servers don’t like (for example, forbes) and will return “Emply reply from server”. To fix you need to also set CURLOPT_HTTPGET to reset back to GET request.

    /* don’t download the page, just the header (much faster in this case) */
curl_setopt($ch, CURLOPT_NOBODY, true);
curl_setopt($ch, CURLOPT_HEADER, true);
curl_setopt($ch, CURLOPT_HTTPGET, true); //this is needed to fix the issue
    • 0