# # All robots should not crawl # /Labyrinth/ spam robot trap # /~FluidLab/calendar/ PHP web-app with too many links # User-agent: * Disallow: /Labyrinth/ Disallow: /~FluidLab/calendar/ # # http://www.archive.org # Keeps files too long (like test solutions). # User-agent: ia_archiver Disallow: /