Tag Archives: optimised robots.txt file

Robots.txt | Tell the Search Engines Only What You Want Them To See.

Occasionally I go over to Googles’ Webmaster Tools to check out my sitesmaps. Today I checked out the Webseo sitemap and was knocked off my chair when I had a look at my robots.txt file. Search engines, mainly the big … Continue reading

Posted in Website Optimization Tricks | Tagged , , , , , , | 9 Comments