I was not thinking fully the other day, when i edited my Robots.txt file to deny access to my feed. For some reason i did not notice properly when i added the deny until this morning when i noticed all my latest posts were not displaying in the search engines.. I was trying to work out why for a while there until i checked my robots.txt file and the answer was right there. I was denying my feed.
Disallow: /feed/
If you edit your robots.txt file it is important to not Disallow feed, now my robots.txt file looks like this -
sitemap: http://www.buyers-web.com/sitemap.xml
User-agent: *
Disallow: /cgi-bin/
Disallow: /go/
Disallow: /archives/
Disallow: /trackback/
Disallow: /wp-admin/
All my posts are being added again now and back to normal, it goes to show how powerful that important file can be…
Learn how to make money like the top bloggers with my book Six Figure Blogging.
