# Small robots.txt # More information about this file can be found at # http://www.robotstxt.org/ # In case your drupal site is in a subdirectory of your web root (e.g. /drupal) # add the name of this directory before the / (slash) below # example: Disallow: /drupal/aggregator # to stop a polite robot indexing an example dir # add a line like: user-agent: polite-bot # and: Disallow: /example-dir/ # Paths (clean URLs) User-agent: * Disallow: /web2/aggregator Disallow: /web2/tracker Disallow: /web2/comment/reply Disallow: /web2/node/add Disallow: /web2/user Disallow: /web2/files Disallow: /web2/search Disallow: /web2/book/print Disallow: /web2/audio Disallow: /web2/audio/* Disallow: /web2/admin Disallow: /web2/modules Disallow: /typo3