How to add items to robots.txt with WordPress
If you wasn’t aware, WordPress auto-generates its own robots.txt file, and that there is a filter that you can hook into to allow you to add your own rules to the file. The filter in question is robots_txt filter. Using this information I hand crafted this handy little snippet: So there you go, a short, but handy little blog …