User-agent: SemrushBot
User-agent: AhrefsBot
User-agent: DotBot
User-agent: rogerbot
User-agent: MJ12bot
User-agent: serpstatbot
Disallow: /

User-agent: *
Disallow: /_pt/
Disallow: /getdeal/*

Sitemap: https://www.cheapbikeparts.co.uk/sitemap.xml