# robots.txt for adambrown.info User-agent: * Disallow: /crons/ Disallow: /docs/tools/sourcefiles/ Disallow: /docs/about/ Disallow: /docs/courses/ Disallow: /summary_editor/ Disallow: /grademailer/ Disallow: /p/tools/grademailer/ Disallow: /p/summaries/ Disallow: /d/gallery/ Disallow: /wiki/ Disallow: /images/ Disallow: /text_new/ # Only google recognizes these wildcards, but let's use them: Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.png$ Disallow: /p/courses/*.pdf$