Question

I would like to add some text to my HTML that is not accessible or indexed by search bots.

Is it possible to have visible text on a site that is not accessible to search bots?

Answer 1

Yes there are a few ways:

1. Deny access with robots.txt (to directories, html pages)

User-agent: *
Disallow: /something.html

2. Add robots meta-tag to your html page:

<meta name="robots" content="noindex">

3. Use <noindex> tag. Note that it’s not supported by all search-robots;

<noindex>this may be seen by some of them</noindex>

4. Use javascript (to hide just some text and not the whole page).

<script>document.write("Something");</script>