user-agent: Pinterestbot Crawl-delay: 2 User-Agent: 008 Disallow: / User-Agent: Dynamite Data crawl-delay: 10 User-agent: ScanAlert Crawl-Delay: 7 User-agent: Googlebot Crawl-Delay: 3 Disallow: /*mv_arg= Disallow: /*?visitor Disallow: /cgi-bin/tech4less/login/ User-agent: YodaoBot Crawl-Delay: 7 User-agent: NPBot Disallow: / User-agent: YahooSeeker Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: Fatbot Disallow: / User-Agent: FatBot Disallow: / User-agent: BecomeBot Crawl-Delay: 30 User-agent: msnbot Crawl-delay: 30 User-agent: MSRBOT Crawl-delay: 15 User-agent: VoilaBot Disallow: / User-agent: Gigabot Disallow: /*id= Disallow: /*q_page= Disallow: /*mv_pc= Disallow: /cgi-bin/tech4less/scan/ Disallow: /cgi-bin/tech4less/login/ User-agent: ShopWiki Crawl-Delay: 10 Disallow: /*id= Disallow: /*mv_pc= Disallow: /*q_page= Disallow: /*mv_arg= Disallow: /cgi-bin/tech4less/scan/ Disallow: /cgi-bin/tech4less/login/ User-agent: * Disallow: /*id= Disallow: /*q_page= Disallow: /cgi-bin/tech4less/admin/ Disallow: /cgi-bin/tech4less/scan/ Disallow: /cgi-bin/tech4less/login/ Disallow: /inventory/ User-agent: Riddlerbot Disallow: / User-agent: Blekkobot Disallow: /inventory Crawl-delay: 9 User-agent: Slurp Crawl-delay: 4 Sitemap: https://www.techforless.com/cgi-bin/tech4less/sitemap.html