Agent Directory

← Back to all companies

YelpUnited States

Local · United States

Verdict
BlockedCovers all 5 agentsUnconfirmed lead: ConditionalFrom technical signals only; no company statement found.
Company statement
None found
robots.txt signals
Blocked
Last checked
Fee
Paid
x402
Unknown
Notes
Reportedly only agents paying into data licensing. Unverified.
Human verified
Not yet

By agent

AgentResultBasis
ChatGPTBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
ClaudeBlockedrobots.txt rule
PerplexityBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
GeminiBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
Meta AIBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
Meta MuseNo dataReported to send a generic Chromium-on-Linux user agent, so it cannot be targeted or detected via robots.txt; only company statements can speak to it.

Consumer surfaces

Evidence

Source typeAgentsResultEvidence levelObservedSource
robots.txt Check
Consumer agents
  • ChatGPT-User (the vendor says it may ignore robots.txt)
  • Claude-User
  • Perplexity-User (the vendor says it may ignore robots.txt)
Search crawlers
  • Claude-SearchBot
  • PerplexityBot
Italic: the vendor says it may ignore robots.txt.		 Blocked Our Check2026-11-08 View source
Allow: /article$
Allow: /article/
Disallow: /
robots.txt Check
Consumer agents
  • Google-Agent (the vendor says it may ignore robots.txt)
  • Amzn-User (the vendor says it may ignore robots.txt)
  • MistralAI-User (the vendor says it may ignore robots.txt)
Search crawlers
  • Amzn-SearchBot
  • Meta-WebIndexer
  • DuckAssistBot
Training crawlers
  • Applebot-Extended
  • Amazonbot
  • Bytespider
Italic: the vendor says it may ignore robots.txt.Applies through the wildcard (*) rule.		 Blocked Our Check2026-11-08 View source
Disallow: /
robots.txt Check
Consumer agents
  • Meta-ExternalFetcher (the vendor says it may ignore robots.txt)
Training crawlers
  • GPTBot
  • ClaudeBot
  • Google-Extended
  • CCBot
  • Meta-ExternalAgent
Italic: the vendor says it may ignore robots.txt.		 Blocked Our Check2026-11-08 View source
Disallow: /
robots.txt Check
Search crawlers
  • OAI-SearchBot
 Blocked Our Check2026-11-08 View source
Allow: /spk/
Allow: /article$
Allow: /article/
Disallow: /
Company Statement Consumer Agent Conditional Unverified Lead2026-11-01 View source

robots.txt checks

HostResultLast checkedUnchanged sinceContent-Signal
yelp.comRead (200)2026-11-08 04:00 UTC2026-11-03None

A robots.txt with no agent-specific rules produces no result, and silence is not the same as allowed. A refused or unreachable check says nothing about the site's rules.

Evidence levels: Our Check is a direct read of the site's robots.txt, Company Document is confirmed by a quote, News Report is reported by a reputable outlet, and Unverified Lead never sets a verdict. Methodology v2. View as JSON