# NO access User-agent: libwww-perl/5.803 User-agent: psbot User-agent: Googlebot-Image User-agent: ASPSeek User-agent: asterias User-agent: baiduspider User-agent: BravoBrian User-agent: dloader(NaverRobot) User-agent: Dumbot User-agent: EgotoBot User-agent: Gaisbot User-agent: Generic User-agent: grub-client User-agent: http://www.almaden.ibm.com/cs/crawler User-agent: InfoNaviRobot User-agent: jyxobot User-agent: Larbin User-agent: MSIECrawler User-agent: NaverBot/1.0 User-agent: NaverBot User-agent: NaverRobot User-agent: NexaBot User-agent: NPBot User-agent: obot User-agent: OWR_Crawler User-agent: PhpDig User-agent: psbot User-agent: puf User-agent: QuepasaCreep User-agent: rabaz User-agent: Reaper User-agent: RPT-HTTPClient User-agent: ScoutAbout User-agent: semanticdiscovery User-agent: Steeler User-agent: Teleport Pro User-agent: TurnitinBot User-agent: TutorGig User-agent: vsecrawler User-agent: Wget Disallow: / # Partial access (All Spiders) User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/ Disallow: /tag/