Skip to content
AmazonTraining

Amazonbot

Amazonbot is a crawler run by Amazon. It collects web content for Amazon AI products.

What it does

Amazonbot collects pages to train or improve AI models. Most operators use a separate user agent for each job, so you can usually allow or block one without affecting the others.

Model training and content-use controls. Some also govern answer grounding; review the operator's policy before changing access.

User agent

Amazonbot

Requests from Amazonbot carry this token in their user agent string. Match the token rather than a full string, which changes as Amazon updates versions.

robots.txt

To block Amazonbot, add this to the robots.txt at the root of your site:

User-agent: Amazonbot Disallow: /

Blocking it asks the operator not to use your pages for model training from then on. It does not remove content already collected, and it does not stop the operator's search crawler or live fetchers, which use their own user agents.

To allow it explicitly, for example after a broader rule blocks other crawlers:

User-agent: Amazonbot Allow: /

Check what your robots.txt allows for Amazonbot and the other AI crawlers in this directory.

Verifying requests

Amazon publishes the IP addresses Amazonbot uses. A request that claims to be Amazonbot from any other address is not genuine.

In SurfacedBy

SurfacedBy's AI traffic tracking recognizes Amazonbot in the user agent and checks each request against Amazon's published addresses. Only requests that pass count as crawls; the rest are shown separately.

Operator documentation

Details on this page come from Amazon's own documentation: developer.amazon.com/amazonbot.

More from Amazon

Common Questions

What is Amazonbot?
Amazonbot is a crawler run by Amazon. It collects web content for Amazon AI products.
How do I block Amazonbot in robots.txt?
Add a group for Amazonbot with "Disallow: /" to the robots.txt at the root of your site. Blocking it asks the operator not to use your pages for model training from then on. It does not remove content already collected, and it does not stop the operator's search crawler or live fetchers, which use their own user agents.
How can I tell if a request is really Amazonbot?
Amazon publishes the IP addresses Amazonbot uses. A request that claims to be Amazonbot from any other address is not genuine.