Question

I am making a desktop yellowpage application. I can access all countries yellowpage site but not australian site. I dont know why?

Here is the code

class Program
{
    static void Main(string[] args)
    {
        WebClient wb = new WebClient();
        wb.Headers.Add("user-agent", "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US)");
        string html = wb.DownloadString("http://www.yellowpages.com.au");
        Console.WriteLine(html);
    }
}

For all other site I get html of the website for australian site I get null. i even tried httpwebrequest also.

Here is the yellowpage australian site: http://www.yellowpages.com.au

Thanks in advance

Answer 1

It looks like that website will only send over gzip’ed data. Try switching to HttpWebRequest and using auto decompression:

var request = (HttpWebRequest)WebRequest.Create("http://www.yellowpages.com.au");
request.UserAgent = "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705;)";
request.Headers.Add(HttpRequestHeader.AcceptEncoding, "gzip,deflate");
request.AutomaticDecompression = DecompressionMethods.GZip | DecompressionMethods.Deflate;