Amazonbot
Amazonbot is a crawler run by Amazon. It collects web content for Amazon AI products.
What it does
Amazonbot collects pages to train or improve AI models. Most operators use a separate user agent for each job, so you can usually allow or block one without affecting the others.
Model training and content-use controls. Some also govern answer grounding; review the operator's policy before changing access.
User agent
AmazonbotRequests from Amazonbot carry this token in their user agent string. Match the token rather than a full string, which changes as Amazon updates versions.
robots.txt
To block Amazonbot, add this to the robots.txt at the root of your site:
User-agent: Amazonbot
Disallow: /Blocking it asks the operator not to use your pages for model training from then on. It does not remove content already collected, and it does not stop the operator's search crawler or live fetchers, which use their own user agents.
To allow it explicitly, for example after a broader rule blocks other crawlers:
User-agent: Amazonbot
Allow: /Check what your robots.txt allows for Amazonbot and the other AI crawlers in this directory.
Verifying requests
Amazon publishes the IP addresses Amazonbot uses. A request that claims to be Amazonbot from any other address is not genuine.
In SurfacedBy
SurfacedBy's AI traffic tracking recognizes Amazonbot in the user agent and checks each request against Amazon's published addresses. Only requests that pass count as crawls; the rest are shown separately.
Operator documentation
Details on this page come from Amazon's own documentation: developer.amazon.com/amazonbot.