I was not thinking fully the other day, when i edited my Robots.txt file to deny access to my feed. For some reason i did not notice properly when i added the deny until this morning when i noticed all my latest posts were not displaying in the search engines.. I was trying to work out why for a while there until i checked my robots.txt file and the answer was right there. I was denying my feed.
Disallow: /feed/
If you edit your robots.txt file it is important to not Disallow feed, now my robots.txt file looks like this -
sitemap: http://www.buyers-web.com/sitemap.xml
User-agent: *
Disallow: /cgi-bin/
Disallow: /go/
Disallow: /archives/
Disallow: /trackback/
Disallow: /wp-admin/
All my posts are being added again now and back to normal, it goes to show how powerful that important file can be…
Recent Comments