User-agent: panscient.com Disallow: / User-agent: pantest Disallow: / User-agent: Seekport Disallow: / User-agent: DataForSeoBot Crawl-delay: 60 Disallow: / User-agent: netEstate NE Crawler Disallow: / User-agent: serpstatbot Disallow: / User-agent: SeznamBot Disallow: / User-agent: MegaIndex Disallow: / User-agent: DAUM Disallow: / User-agent: Linguee Disallow: / User-agent: amazonbot Crawl-delay: 60 Disallow: *%20* Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: Applebot Crawl-delay: 120 Disallow: *%20* Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: Scoutjet Crawl-delay: 60 Disallow: *%20* Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: The Knowledge AI Disallow: *%20* Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: EmailSiphon Disallow: / User-agent: LinkWalker Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Gaisbot Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: FindLinks Disallow: / User-agent: Twiceler Crawl-Delay: 600 Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: CCBot Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: BecomeBot Crawl-Delay: 300 Disallow: /DanceDB Disallow: /Ashokan Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: 008 Crawl-Delay: 300 Disallow: /DanceDB Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: MuscatFerret Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: MuscatMSI Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: WebtopOtter Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: googlebot Crawl-delay: 60 Disallow: *%20* Disallow: *11111111* Disallow: *gettoknow.site* Disallow: /Ashokan Disallow: /ashokan Disallow: /Hemshekh Disallow: /hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: grub-client Disallow: /DanceDB Disallow: /Ashokan Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: ia_archiver Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: archive.org_bot Crawl-delay: 300 Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: SlySearch Disallow: /DanceDB Disallow: /Ashokan Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: TurnitinBot Disallow: /DanceDB Disallow: /Dance%20DB Disallow: /Ashokan Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: Pompos Disallow: /Ashokan Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: NPBot Disallow: /DanceDB Disallow: /Ashokan Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: ASPSeek Disallow: /DanceDB Disallow: /Ashokan Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: BaiDuSpider Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: ConveraCrawler Disallow: /DanceDB Disallow: /Ashokan Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: MSNBot Crawl-delay: 1500 Disallow: *%20* Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: msnbot Crawl-delay: 1500 Disallow: *%20* Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: BingBot Crawl-delay: 1500 Disallow: *%20* Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: GPTBot Crawl-delay: 1200 Disallow: *%20* Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: bingbot Crawl-delay: 1500 Disallow: *%20* Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: Accoona Crawl-Delay: 300 Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: Slurp Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Crawl-delay: 900 User-agent: dotbot Disallow: / User-agent: ezooms Disallow: / User-agent: Charlotte Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Crawl-delay: 900 User-agent: Ocelli Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: NutchCVS Disallow: / User-agent: Gigabot Crawl-Delay: 840 Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Disallow: /Ashokan/DisplayImage.com Disallow: /DanceDB/DisplayImage.com Disallow: /DisplayIdentGallery.com Disallow: /TCCD/DisplayImage.com Disallow: /PuertoRico/DisplayImage.com User-agent: oBot Disallow: / User-agent: genieBot Disallow: / User-agent: noxtrumbot Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Disallow: /DanceDB/Edit.com User-agent: MSR-ISRCCrawler Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Disallow: /DanceDB/Edit.com User-agent: ShopWiki Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Disallow: /DanceDB/Edit.com Disallow: /Hemshekh Disallow: /Ashokan Disallow: /Ashokan/DisplayImage.com Disallow: /DanceDB/DisplayImage.com Disallow: /DisplayIdentGallery.com Crawl-Delay: 300 User-agent: MJ12bot Crawl-Delay: 20 Disallow: /DanceDB Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Disallow: /DanceDB/Edit.com Disallow: /Ashokan/DisplayImage.com Disallow: /DanceDB/DisplayImage.com Disallow: /DisplayIdentGallery.com Disallow: /TCCD/DisplayImage.com Disallow: /PuertoRico/DisplayImage.com Disallow: /Hemshekh User-agent: IRLbot Crawl-Delay: 300 Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Disallow: /Ashokan Disallow: /Hemshekh User-agent: Yandex Disallow: /Ashokan Disallow: /DanceDB/DisplayIdent.com Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Crawl-Delay: 600 User-agent: YandexBot Disallow: /Ashokan Disallow: /DanceDB/DisplayIdent.com Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com Crawl-Delay: 600 User-agent: Cliqzbot Disallow: / User-agent: Yanga Crawl-Delay: 300 Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: MLBot Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: Yeti Crawl-Delay: 300 Disallow: /Ashokan Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /Hemshekh Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: discobot Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: sitebot Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: sistrix Crawl-Delay: 600 Disallow: /Ashokan Disallow: /Hemshekh Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: Riddler Disallow: / User-agent: BUbiNG Disallow: / User-agent: Barkrowler Disallow: / User-agent: MauiBot Disallow: / User-agent: YaK Disallow: / User-agent: * Crawl-Delay: 300 Disallow: /DISCOtech Disallow: /DISCOtech/ Disallow: /DISCOtech/default.htp Disallow: /DISCOtech/Directory.htp Disallow: /DISCOtech/Reports.htp Disallow: /DISCOtech/Status199704.htp Disallow: /DISCOtech/VEST.htp Disallow: /DISCOtech/FinePayment199704.htp Disallow: /DISCOtech/DAVID_DB.htp Disallow: /DISCOtech/DAVIDstation.htp Disallow: /Ashokan/Default.htp Disallow: /Ashokan/default.htp Disallow: /Ashokan/List.htp Disallow: /Ashokan/list.htp Disallow: /DanceDB/Edit.com Disallow: /cgi/ProtectMail.com Disallow: /cgi/ProtectMail2.com