User-agent: * Disallow: /suchverl/ Disallow: /cgi-bin/ Disallow: /pic/ Disallow: /js/ Disallow: /css/ #User-agent: Firefly/1.0 #Disallow: / User-agent: WebReaper Disallow: / User-agent: Wget Disallow: / User-agent: HTTrack Disallow: / #User-agent: Dumbot #Disallow: /