Question

I have this code that works fine on my local server but doesn’t work on a live server.
I’m trying to scrap without getting blocked.

If a proxy gets blocked by the remote server then how come it’s working on my local server?

function curl_se($set_url,$proxy){

    $ch = curl_init($set_url);
    //set options
    $header[0] = "Accept: text/xml,application/xml,application/xhtml+xml,"; 
    $header[0] .= "text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5"; 
    $header[] = "Cache-Control: max-age=0"; 
    $header[] = "Connection: keep-alive"; 
    $header[] = "Keep-Alive: 300"; 
    $header[] = "Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7"; 
    $header[] = "Accept-Language: en-us,en;q=0.5"; 
    $header[] = "Pragma: "; //browsers keep this blank.
    //set options
    curl_setopt($ch, CURLOPT_CONNECTTIMEOUT, 30);
    curl_setopt($ch, CURLOPT_USERAGENT,"Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3");
    curl_setopt($ch, CURLOPT_ENCODING, 'gzip,deflate'); 
    curl_setopt($ch, CURLOPT_HTTPHEADER, $header); 
    curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
    curl_setopt($ch, CURLOPT_HTTPPROXYTUNNEL, 0);
    curl_setopt($ch, CURLOPT_PROXY, $proxy);
    curl_setopt($ch, CURLOPT_HEADER, false);
    curl_setopt($ch, CURLOPT_FOLLOWLOCATION, 1);
    $result = curl_exec($ch);
    echo "<pre>";
    print_r(curl_getinfo($ch));
    echo "</pre>";
    if(curl_errno($ch))
        return false;
    else
        return $result; 
}

Looping one proxy on each curl request.

$proxy = array(
    "91.83.216.186:8081",
    "190.116.88.11:8080",
    "117.102.9.116:8080",
    "188.165.4.38:3128",
    "187.120.209.10:8080",
    "190.186.50.32:3128",
    "190.108.83.30:8080",
    "190.130.230.149:8080",
    "130.180.18.24:8275",
    "178.33.181.120:8080"
);

On the live server I’m getting curl error 7 (CURLE_COULDNT_CONNECT)

I’m stuck, it’s the same code same URL working fine locally.

Update: I figured out that it’s something to do with proxy. I tried hundreds of them but none is working on live server getting curl error no 7; tried different website URLs too.
while same proxy and URLs are working on my local server.

Answer 1

Try working proxies. Check here (codepad.viper-7.com/xzm8Au) your server is running just fine.
When you use anonymous proxy, then the remote(destination) server can’t see or block your real ip.