# robots.txt User-agent: Googlebot Disallow: User-agent: Feedfetcher-Google Disallow: User-agent: Mediapartners-Google Disallow: User-agent: Googlebot-Image Disallow: User-agent: Google-Sitemaps Disallow: User-agent: Google WAP Proxy Disallow: User-agent: Googlebot-Mobile Disallow: User-agent: Scooter Disallow: User-agent: Y!J-SRD Disallow: User-agent: Y!J-BSC Disallow: User-agent: Yahoo! Mindset Disallow: User-agent: Yahoo-Blogs Disallow: User-agent: Yahoo-MMAudVid Disallow: User-agent: YahooFeedSeeker Disallow: User-agent: YahooSeeker Disallow: User-agent: Sqworm Disallow: User-agent: DoCoMo Disallow: User-agent: MSNBot Disallow: User-agent: Slurp Disallow: User-agent: Teoma Disallow: User-agent: twiceler Disallow: User-agent: Gigabot Disallow: User-agent: Scrubby Disallow: User-agent: Sphere Scout Disallow: User-agent: Sphere Scout&v4.0 Disallow: User-agent: Sphere Related Content Fetcher Disallow: User-agent: Moreoverbot/5.00 (+http://www.moreover.com) Disallow: User-agent: Robozilla Disallow: User-agent: Nutch Disallow: User-agent: Baiduspider Disallow: User-agent: Yahoo! Slurp China Disallow: User-agent: yahoo-mmcrawler Disallow: User-agent: psbot Disallow: User-agent: asterias Disallow: User-agent: yahoo-blogs/v3.9 Disallow: User-agent: BlogzIce Disallow: User-agent: Bloglines Title Fetch Disallow: User-agent: larbin_2.2.0 Disallow: User-agent: FAST-WebCrawler Disallow: User-agent: FAST Enterprise Crawler 6 Disallow: User-agent: Sogou web spider/4.0 Disallow: User-agent: R6_FeedFetcher Disallow: User-agent: BlogSearch Disallow: User-agent: Technoratibot Disallow: User-agent: VoilaBot Disallow: User-agent: FeedBurner Disallow: User-agent: Charlotte Disallow: User-agent: proximic Disallow: User-agent: Snapbot Disallow: User-agent: BlogPulseLive Disallow: User-agent: BlogPeople Java/1.4.2_04 Disallow: User-agent: BlogPeople Java Disallow: User-agent: Twingly Disallow: User-agent: Twingly Recon Disallow: User-agent: Yoriwa/0.1 Disallow: User-agent: LeapTag Disallow: Crawl-delay: 60 Disallow: /biotech-0/ Disallow: /biotech-1/ Disallow: /biotech-2/ Disallow: /biotech-3/ Disallow: /biotech-4/ Disallow: /biotech-5/ Disallow: /biotech-6/ Disallow: /biotech-7/ Disallow: /biotech-8/ Disallow: /biotech-9/ Disallow: /biotech-10/ Disallow: /biotech-11/ Disallow: /biotech-12/ Disallow: /biotech-13/ Disallow: /biotech-14/ Disallow: /biotech-15/ Disallow: /biotech-16/ Disallow: /biotech-17/ Disallow: /biotech-18/ Disallow: /biotech-19/ Disallow: /cgi-bin/ Disallow: /eclipses/ Disallow: /lasik_surgery0/ Disallow: /lasik_surgery1/ Disallow: /lasik_surgery2/ Disallow: /lasik_surgery3/ Disallow: /lasik_surgery4/ Disallow: /lasik_surgery5/ Disallow: /lasik_surgery6/ Disallow: /lasik_surgery7/ Disallow: /lasik_surgery8/ Disallow: /lasik_surgery9/ Disallow: /lasik_surgery10/ Disallow: /lasik_surgery11/ Disallow: /lasik_surgery12/ Disallow: /lasik_surgery13/ Disallow: /lasik_surgery14/ Disallow: /lasik_surgery15/ Disallow: /lasik_surgery16/ Disallow: /lasik_surgery17/ Disallow: /lasik_surgery18/ Disallow: /lasik_surgery19/ Disallow: /ImageMagick/ Disallow: /translate/