Comments on: Robots.txt | Tell the Search Engines Only What You Want Them To See. http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/ Website promotion and search engine tips. Sun, 29 Aug 2010 13:07:16 +0000 hourly 1 http://wordpress.org/?v=3.0 By: Groom Wedding Speech http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-2189 Groom Wedding Speech Thu, 12 Aug 2010 14:17:14 +0000 http://www.webseo.com.au/blog/?p=385#comment-2189 lee, i don't understand what's your problem. your site doesn't even exist and it is not indexed by google. instead i see you posted on a lot of blogs and forums about this... what's the catch? lee, i don’t understand what’s your problem. your site doesn’t even exist and it is not indexed by google. instead i see you posted on a lot of blogs and forums about this… what’s the catch?

]]> By: lee http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-917 lee Fri, 11 Sep 2009 19:47:52 +0000 http://www.webseo.com.au/blog/?p=385#comment-917 my blog www.diyanswerdirect.com/blog hasnt been indexed for two weeks and my site www.diyanswerdirect.com has been indexed but never gets updated. Is there anyone who can tell me when google or bing updates there search engines please thankyou lee my blog http://www.diyanswerdirect.com/blog hasnt been indexed for two weeks and my site http://www.diyanswerdirect.com has been indexed but never gets updated. Is there anyone who can tell me when google or bing updates there search engines please thankyou lee

]]> By: ali qayyum http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-879 ali qayyum Thu, 03 Sep 2009 12:27:15 +0000 http://www.webseo.com.au/blog/?p=385#comment-879 ok i m sending plz tell me, how should i deal now? ok i m sending plz tell me, how should i deal now?

]]> By: admin http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-878 admin Thu, 03 Sep 2009 12:23:45 +0000 http://www.webseo.com.au/blog/?p=385#comment-878 Ali yes send me the screen shots. Send to steve@webseo.com.au Steve Ali yes send me the screen shots. Send to steve@webseo.com.au

Steve

]]> By: ali qayyum http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-877 ali qayyum Thu, 03 Sep 2009 12:15:36 +0000 http://www.webseo.com.au/blog/?p=385#comment-877 ok can i send you my screenshot of webmaster tool ok
can i send you my screenshot of webmaster tool

]]> By: admin http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-875 admin Thu, 03 Sep 2009 08:11:42 +0000 http://www.webseo.com.au/blog/?p=385#comment-875 Ali I looked at your robots.txt file and it is very basic. A robots.txt file should tell the search engines what you want them to see and what you dont want them to see. In your case I would do a search on Google for robots.txt "blogspot" You will find lots of information on how to develop a good robots.txt file. Then you should'nt get any eoors at Google Webmaster. As far as your category problem, it shouldnt be a problem, but if it is I can not fix it for you. I clicked on a category label and it worked fine for me. Steve Ali I looked at your robots.txt file and it is very basic. A robots.txt file should tell the search engines what you want them to see and what you dont want them to see. In your case I would do a search on Google for robots.txt “blogspot” You will find lots of information on how to develop a good robots.txt file. Then you should’nt get any eoors at Google Webmaster.

As far as your category problem, it shouldnt be a problem, but if it is I can not fix it for you. I clicked on a category label and it worked fine for me.

Steve

]]> By: Ali Qayyum http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-873 Ali Qayyum Wed, 02 Sep 2009 14:02:01 +0000 http://www.webseo.com.au/blog/?p=385#comment-873 yes , this is my website, http://alisoft7.blogspot.com actually, since , i submitted the website in google webmaster. i have faced one problem regarding robot.txt file. "Restricted by robots.txt ‎(27)‎" i have see this error. so how should i remove this error. Secondly, mostly, i have deleted my categories labels from my blog. so. is this creating me in problem? can u solve my problem yes , this is my website, http://alisoft7.blogspot.com
actually, since , i submitted the website in google webmaster. i have faced one problem regarding robot.txt file. “Restricted by robots.txt ‎(27)‎” i have see this error.
so how should i remove this error.
Secondly, mostly, i have deleted my categories labels from my blog. so. is this creating me in problem?
can u solve my problem

]]> By: admin http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-868 admin Wed, 02 Sep 2009 08:09:42 +0000 http://www.webseo.com.au/blog/?p=385#comment-868 Ali a robot.txt file is a file you place on you hosting server to tell the search engines what files and folders you want them to crawl (read) and then hopefully add to their search indexes. Do you have one on your website? Ali a robot.txt file is a file you place on you hosting server to tell the search engines what files and folders you want them to crawl (read) and then hopefully add to their search indexes. Do you have one on your website?

]]> By: ali qayyum http://www.webseo.com.au/blog/robots-txt-tell-the-search-engines-only-what-you-want-them-to-see/comment-page-1/#comment-867 ali qayyum Wed, 02 Sep 2009 07:52:18 +0000 http://www.webseo.com.au/blog/?p=385#comment-867 can u tell me? i wanted to crawl my blog in the google so what is my robot.txt can u tell me? i wanted to crawl my blog in the google
so what is my robot.txt

]]>