Robots.txt Overview, Generator, & Analyzer

Nice work Aaron, this will be a great help to people not usually used to using robots.txt.
The generator in particular is user friendly and helpful.

Thanks.

thanks, aaron. i didn't know that spaces in user-agent strings are a bad idea.

This post and the http://tools.seobook.com/robots-txt/ post are excellent - succinct and cover some very helpful elements.

Thanks Aaron.

Ben

Glad you found them helpful Ben. :)

great tool.It really helps. I tried it myself.Also went to see the robot.txt tutorial. There are lots of goodies here.Thanks a lot. It really helps especially newbies like me.

Nice tool Aaron.

I thought our robots would pass your analyser and I was embarrased to find some faults! So thanks!

Mike