Ways to prevent search engines from indexing your private site

You created your very own personal home on the web. However, the site turning up into search engines and web directories, revealing your personal details. It is very simple to protect your site from search engines by adding a small code in your web pages and adding a small text file.

Method 1
Add meta tag to head of your
< META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW" >

Method 2
Create a robots.txt (all lower-case) using any simple text editor like Notepad.
Save it into your root directory to prevent search bots from accessing any page on your site.
Type the details exactly as give below into the robots.txt file

To exclude all robots from the entire server
User-agent: *
Disallow: /

To allow all robots complete access
User-agent: *
Disallow:
Or create an empty "/robots.txt" file.

To exclude all robots from part of the server
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /private/

To exclude a single robot
User-agent: BadBot
Disallow: /

To allow a single robot
User-agent: WebCrawler
Disallow:

User-agent: *
Disallow: /

More information is available here.
This site has moved to a shiny new domain. Click here »