User-agent: AhrefsBot
User-agent: CCBot
User-agent: Icarus6j
User-agent: MJ12bot
User-agent: Vagabondo
User-agent: VeBot
User-agent: XoviBot
User-agent: dotbot
User-agent: ia_archiver
Disallow: /

User-agent: archive.org_bot
User-agent: Baiduspider
User-agent: Yandex
User-agent: linkdexbot/2.0
User-agent: linkdexbot/2.1
User-agent: linkdexbot/2.2
Disallow: /product

User-agent: *
Crawl-delay: 60
Disallow: /redirect
Disallow: /account
Disallow: /pricealert/add

Sitemap: http://www.shoptimate.fr/sitemap.xml