Skip to content
LinerSearch indexing

LinerBot

LinerBot is a crawler run by Liner. It indexes the web for Liner AI search.

What it does

LinerBot crawls pages to build the search index an AI platform answers from. Most operators use a separate user agent for each job, so you can usually allow or block one without affecting the others.

Crawlers that build search indexes used by AI platforms. Access supports discovery but does not guarantee a listing or citation.

User agent

LinerBot

Requests from LinerBot carry this token in their user agent string. Match the token rather than a full string, which changes as Liner updates versions.

robots.txt

To block LinerBot, add this to the robots.txt at the root of your site:

User-agent: LinerBot Disallow: /

Blocking it keeps your pages out of that index, so the platform has less of your content to find and cite. Allowing it makes your pages eligible, not guaranteed, to appear in answers.

To allow it explicitly, for example after a broader rule blocks other crawlers:

User-agent: LinerBot Allow: /

Check what your robots.txt allows for LinerBot and the other AI crawlers in this directory.

Verifying requests

Liner publishes the IP addresses LinerBot uses. A request that claims to be LinerBot from any other address is not genuine.

In SurfacedBy

SurfacedBy's AI traffic tracking recognizes LinerBot in the user agent and checks each request against Liner's published addresses. Only requests that pass count as crawls; the rest are shown separately.

Operator documentation

Details on this page come from Liner's own documentation: docs.getliner.com/docs/linerbot.

Common Questions

What is LinerBot?
LinerBot is a crawler run by Liner. It indexes the web for Liner AI search.
How do I block LinerBot in robots.txt?
Add a group for LinerBot with "Disallow: /" to the robots.txt at the root of your site. Blocking it keeps your pages out of that index, so the platform has less of your content to find and cite. Allowing it makes your pages eligible, not guaranteed, to appear in answers.
How can I tell if a request is really LinerBot?
Liner publishes the IP addresses LinerBot uses. A request that claims to be LinerBot from any other address is not genuine.