# This is a demo of what the KB Robots.txt manager does. You'll see that it looks just like any other robots.txt file. # Comments are preceded by a #. # If I wanted to ban the EvilBot from crawling any of my site: User-agent: Evilbot Disallow: / # If I wanted to keep robots from indexing a particular path, such as one with photos: User-agent: * Disallow: /photos/ # you get the idea. Note that a true robots.txt file would be at the root, that is, at adambrown.info/robots.txt. This is just a demo you're looking at.