Skip to content
MetaLive citation

Meta-ExternalFetcher

Meta-ExternalFetcher is a fetcher run by Meta. It fetches a page when a user or Meta AI agent follows your link.

What it does

Meta-ExternalFetcher fetches a page live when someone asks the AI platform about it. Most operators use a separate user agent for each job, so you can usually allow or block one without affecting the others.

Page fetches requested by AI platform users. A verified request establishes a page read, not a citation or a human visit.

User agent

meta-externalfetcher/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)

This is a full user agent string Meta-ExternalFetcher sends. Version numbers change over time; match the Meta-ExternalFetcher token rather than the whole string.

robots.txt

To block Meta-ExternalFetcher, add this to the robots.txt at the root of your site:

User-agent: Meta-ExternalFetcher Disallow: /

Blocking it stops the assistant reading your page when a user asks for it, so the answer is built from other sources. Operators can treat user-requested fetches differently from automatic crawling; check the operator's documentation for how it applies robots.txt.

To allow it explicitly, for example after a broader rule blocks other crawlers:

User-agent: Meta-ExternalFetcher Allow: /

Check what your robots.txt allows for Meta-ExternalFetcher and the other AI crawlers in this directory.

Verifying requests

Meta does not publish a way to verify Meta-ExternalFetcher's requests, so any client can send this user agent. Treat traffic with this name as a claim, not proof.

In SurfacedBy

SurfacedBy's AI traffic tracking recognizes Meta-ExternalFetcher in the user agent. Because SurfacedBy cannot confirm these requests come from Meta, they are shown separately as unverified and are not counted as crawls.

Operator documentation

Details on this page come from Meta's own documentation: developers.facebook.com/documentation/sharing/webmasters/web-crawlers.

More from Meta

Common Questions

What is Meta-ExternalFetcher?
Meta-ExternalFetcher is a fetcher run by Meta. It fetches a page when a user or Meta AI agent follows your link.
How do I block Meta-ExternalFetcher in robots.txt?
Add a group for Meta-ExternalFetcher with "Disallow: /" to the robots.txt at the root of your site. Blocking it stops the assistant reading your page when a user asks for it, so the answer is built from other sources. Operators can treat user-requested fetches differently from automatic crawling; check the operator's documentation for how it applies robots.txt.
How can I tell if a request is really Meta-ExternalFetcher?
Meta does not publish a way to verify Meta-ExternalFetcher's requests, so any client can send this user agent. Treat traffic with this name as a claim, not proof.