| Now a days every one is praying that "Oh God let | | | | the following meta tag on our website. The tag is: |
| Google index and cache my web pages". The article I | | | | Note: Please ignore the symbol "|" from the tag above. |
| am going to write is just the reverse of what common | | | | This tag prevents all spiders from archiving the web |
| man or woman thinks. Many time we need to hide our | | | | page. |
| data from Search Engines. Some times we will be | | | | 2. Setting access permissions |
| shocked that the information which we kept secretly in | | | | We can set a user name and password for a page to |
| our site present in Google cache. That will remain there | | | | view it. Search Engine spiders cannot log on to a page |
| even if I remove it from my web page. So anyone can | | | | using user name and password. So it cannot index |
| easily view it which I removed from my site. To | | | | that page so your web page will never indexed in |
| prevent Google or any major web sites from making | | | | cached link list. |
| cache links of our site follow the tips provided below. | | | | The steps provided above will help to prevent spiders |
| Cache links are created when a spider visit our web | | | | from being caching our web page. But for already |
| page and create a snapshot of it. According to Google | | | | cached webpage what we can do? |
| words "This "cached" version allows a webpage to be | | | | Remove a cached link |
| retrieved for your end users if the original page is ever | | | | To remove an already indexed link from cached list |
| unavailable (due to temporary failure of the web | | | | we can send a request to google from google |
| server)". The cached page will look exactly same as | | | | webmaster tool. To perform this follow the steps |
| how the page looks at the time of spider visit. To see | | | | below. |
| the cached links of your website follow the command | | | | 1. Log on to Google webmaster tools |
| below.cache:your URL | | | | 2. Click on Tools |
| On Google search box you can type the command | | | | 3. Click on remove URL |
| "cache: "and the URL you want to see. The same | | | | 4. Click on new removal requests |
| command is valid for MSN search also. The cached | | | | 5. Enter the URL which is already cached to remove. |
| page will change when spider's next visit on your site. | | | | In a nutshell the robots.txt file on your web server is |
| To exclude google spiders from caching your web | | | | very important. If you edit it without knowing the usage |
| page follow the steps below. | | | | of syntax your site may not indexed well on Search |
| Exclusion of a page from cache: | | | | Engine. In the reverse to un-index a site link also |
| 1. Tell spiders to not archive links using robots.txt | | | | robots.txt file is very important. |
| To exclude a web page from caching we need to use | | | | |