# /robots.txt for activeWeb contentserver driven websites User-agent: * # Verboten #Disallow: /awca/ #Disallow: /aweb/ Disallow: /Fhj/ Disallow: /Source/ Disallow: /source/ Disallow: /Menue_$ Disallow: /aw/Studien_INTERN/ Disallow: /aw/home/Info/WSA-Intern/ Disallow: /aw/home/Hidden/ Disallow: /ca/c/ Disallow: /go/id/bauf/ Disallow: /go/id/bajb/ Disallow: /*.asp$ Disallow: /*.pdf$ Disallow: /*.htm$ Disallow: /*.html$ Disallow: /*contextedit$ Disallow: /*http$ Disallow: /*mailto$ Disallow: /global/show_document.asp$ Disallow: /custom/inc/DBbild.asp$ # Erlaubt Allow: /external.crawl/ Allow: /global/show_picture.asp