# Written By Miranda Johnson # email mjohnson@criw.com #the disallowed agents are known email harvesters used by spammers! User-agent: Titan Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / #allow content to search engine spiders except in the folders User-agent: * Disallow: /AssessmentQuestions/ Disallow: /AssessmentQuestionsX/ Disallow: /bbs/ Disallow: /bbs2/ Disallow: /bbsold2/ Disallow: /CCRecruiting/ Disallow: /cmc/ Disallow: /Content/ Disallow: /Copy of bbsold/ Disallow: /Copy of pp/ Disallow: /CRI/ Disallow: /erg/ Disallow: /Flash/ Disallow: /GACSEC/ Disallow: /hvision/ Disallow: /images/ Disallow: /Includes/ Disallow: /Materials/ Disallow: /MQuest/ Disallow: /oema/ Disallow: /pa/ Disallow: /pp/ Disallow: /ppnew/ Disallow: /RAndR/ Disallow: /samplereports/ Disallow: /sg/ Disallow: /SigmaResource/ Disallow: /Techrecruiting/ Disallow: /test/ Disallow: /TRG/