# robot/spider exclusion for www.cartus.co.uk # http://info.webcrawler.com/mak/projects/robots/robots.html # ban known e-mail harvesters User-agent: EmailSiphon User-agent: CherryPicker/1.0 User-agent: CherryPickerSE/1.0 User-agent: CherryPickerElite/1.0 User-agent: EmailCollector/1.0 User-agent: EmailWolf 1.00 User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 User-agent: NICErsPRO User-agent: WebBandit/2.1 User-agent: WebBandit/3.50 User-agent: Mozilla/2.0 (compatible; NEWT ActiveX; Win32) Disallow: / User-agent: * Disaalow: /annualforum/ Disallow: /cads/ Disallow: /capita/ Disallow: /ceh/ Disallow: /clientconnect/ Disallow: /demo/ Disallow: /docs/ Disallow: /eadmin/ Disallow: /esource/ Disallow: /hhmi/ Disallow: /images/ Disallow: /includes/ Disallow: /jscript/ Disallow: /kraft/ Disallow: /members/ Disallow: /mymove/ Disallow: /omniweb/ Disallow: /pdf/ Disallow: /sellsmartclientguide/ Disallow: /styles/ Disallow: /supplierconnect/ Disallow: /surveys/ Disallow: /timewarner/