Home/ Questions/Q 7421485
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-29T08:25:01+00:00

I was working on a simple application to pull some currency conversions from a

  • 0

I was working on a simple application to pull some currency conversions from a website, when I received an error message (below) stating they had a no automated extraction policy.

Autoextraction Prohibited

Automated extraction of our content is prohibited. See http://www.xe.com/errors/noautoextract.htm.

I don’t really have an intention of breaking their policy but I am curious as to how they can tell. Can anyone enlighten me?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    1) User-Agent

    2) Introducing a Javascript pop-up.Something like Click OK to enter.

    3) Calculating number of request/hour from a particular ip address if you are not behind NAT.

    For more detail take a look at this Pycon talk web-strategies-for-programming-websites-that-don-t-expected-it by asheesh laroia.

    Also take a look at A Standard for Robot Exclusion.

    Some web-sites also use

    4) Captchas and Re-Captchas

    5) Redirection which means you need to add a HTTP Referrer to get your data.

    • 0