Agent Directory

Which sites block AI agents?

What each company's site says to the AI agents people send to shop, book and bank for them.

138 companies

CountryCompany VerdictBy agentLast checkedNotes
Canada
AbeBooksabebooks.com, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Netherlands
Actionaction.com, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Singapore
Agodaagoda.com, Travel
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Malaysia
AirAsiaairasia.com, Travel
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Alibabaalibaba.com, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet Added via the review panel from a Wikidata candidate.
Russia
AliExpressaliexpress.ru, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Poland
Allegroallegro.pl, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
American Airlinesaa.com, Travel
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
Appleapple.com, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Taiwan
ASUSasus.com, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Japan
au (KDDI)au.com, Telecom
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Russia
Avitoavito.ru, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
Bandcampbandcamp.com, Streaming
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Venezuela
BDV | Banco de Venezuelabancodevenezuela.com, Banking
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Russia
Beelinebeeline.ru, Telecom
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
China
Bilibilibilibili.com, Streaming
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
Blueskybsky.app, Social
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
Netherlands
bolbol.com, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United Kingdom
British Airwaysbritishairways.com, Travel
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
Business Insiderbusinessinsider.com, News
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
CBS Newscbsnews.com, News
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
Chewychewy.com, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
China
China Mobile10086.cn, Telecom
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
CNBCcnbc.com, News
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet
United States
Craigslistcraigslist.org, Retail
No Policy FoundNo AI agent rules in robots.txt - needs manual review No agent-level data yet

An agent that is not listed has no data, which does not mean it is allowed. Italic names are agents whose vendors say they may ignore robots.txt, so those rules show the site's preference rather than enforcement.