# Horrible bandwidth eating robots User-agent: AdIdxBot User-agent: AhrefsBot User-Agent: AiHitBot User-Agent: AlphaSeoBot User-Agent: AlphaSeoBot-SA User-agent: Baiduspider User-agent: BingPreview User-Agent: BLEXBot User-Agent: CareerBot User-Agent: Cliqzbot User-Agent: dotbot User-Agent: grapeshot User-agent: ichiro User-Agent: iCjobs User-Agent: linkdexbot User-Agent: magpie-crawler User-Agent: MegaIndex User-agent: MJ12bot User-agent: moget User-agent: NaverBot User-Agent: Owlin User-Agent: Owlin Bot User-Agent: Owlin Bot v. 3.0 User-Agent: proximic User-Agent: QuerySeekerSpider User-Agent: scrapy User-Agent: scrapybot User-Agent: Semrush User-Agent: SemrushBot User-Agent: sentibot User-Agent: SEOkicks-Robot User-agent: SiteAuditBot User-Agent: Sogou User-agent: sogou spider User-agent: SplitSignalBot User-Agent: TkBot User-Agent: trendkite-akashic-crawler User-Agent: Vagabondo User-Agent: WBSearchBot User-agent: Yandex User-agent: YandexBot User-agent: Yeti User-agent: YoudaoBot Disallow: / User-agent: * Allow: /wp-includes/js/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /xmlrpc.php Disallow: /profile Disallow: /cgi-bin/ Disallow: /wp-content/cache/ Disallow: /trackback/ Disallow: /comments/ Disallow: /administrator/ Disallow: */trackback/ Disallow: */comments/ Disallow: /license.txt Disallow: /*.php$ Disallow: *?filter Disallow: /wp-content/themes/ionMag Disallow: /readme.html Sitemap: https://www.bristolflyers.co.uk/sitemap_index.xml