# Agent-specifik Disallow User-agent: BaiDu User-agent: Baiduspider User-agent: Baiduspider+ User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) User-agent: BravoBrian SpiderEngine MarcoPolo User-agent: DynuHTTP User-agent: EmailSiphon User-agent: eseek-larbin_2.6.2 (crawler@exactseek.com) User-agent: eseek-larbin_2.6.2 crawler@exactseek.com User-agent: Gigabot/1.0 User-agent: NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) User-agent: ia_archiver User-agent: larbin_2.6.1 User-agent: larbin_2.6.2 User-agent: larbin_2.6.1 larbin2.6.2@unspecified.mail User-agent: larbin_2.6.2 larbin2.6.2@unspecified.mail User-agent: larbin_2.6.2 (larbin2.6.2@unspecified.mail) User-agent: LARBIN-EXPERIMENTAL efp@gmx.net User-agent: LARBIN-EXPERIMENTAL (efp@gmx.net) User-agent: NutchOrg/0.03-dev (Nutch; http://www.nutch.org/docs/bot.html User-agent: Pompos/1.3 http://dir.com/pompos.html User-agent: QuepasaCreep v0.9.14 User-agent: QuepasaCreep ( crawler@quepasacorp.com ) User-agent: QPCreep Test Rig ( We are not indexing, just testing ) User-agent: Turnitin User-agent: Turnitinbot User-agent: Wget/1.8.2 Disallow: / # Generel Disallow # User-agent:* #Disallow: /assets/files/ Disallow: /assets/images/ Disallow: /manager/ Disallow: phpinfo.php Disallow: test.php