Agent Accepted

← Back to all companies

YahooUnited States

Search · United States

Verdict
BlockedCovers 1 of 5 agentsFrom technical signals only; no company statement found.
Company statement
None found
robots.txt signals
Blocked
Last checked
Fee
Unknown
x402
Unknown
Notes
Triaged automatically from the discovery queue; consumer classification and industry not yet human-reviewed.
Human verified
Not yet

By agent

AgentResultBasis
ChatGPTBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
ClaudeNo dataNo data
PerplexityNo dataNo data
GeminiNo dataGoogle documents Google-Agent for agents hosted on its infrastructure but does not name Gemini; the mapping is unconfirmed.
Meta AINo dataMeta's assistant. Meta documents this token for user-requested fetches but does not name Meta AI; the mapping is unconfirmed.
Meta MuseNo dataReported to send a generic Chromium-on-Linux user agent, so it cannot be targeted or detected via robots.txt; only company statements can speak to it.

Consumer surfaces

Evidence

Source typeAgentsResultEvidence levelObservedSource
robots.txt Check
Consumer agents
  • ChatGPT-User (the vendor says it may ignore robots.txt)
Search crawlers
  • PerplexityBot
Training crawlers
  • GPTBot
  • ClaudeBot
  • Google-Extended
  • CCBot
  • Bytespider
Italic: the vendor says it may ignore robots.txt.		 Blocked Our Check2026-11-08 View source
robots.txt Check
Search crawlers
  • OAI-SearchBot
  • Claude-SearchBot
 Conditional Our Check2026-11-08 View source
Disallow: */articles/
robots.txt Check
Training crawlers
  • GPTBot
  • Google-Extended
 Blocked Our Check2026-11-08 View source
Disallow: /

robots.txt checks

HostResultLast checkedUnchanged sinceContent-Signal
yahoo.co.jpRead (200)2026-11-08 04:00 UTC2026-11-02None
yahoo.comRead (200)2026-11-08 04:00 UTC2026-11-02None

A robots.txt with no agent-specific rules produces no result, and silence is not the same as allowed. A refused or unreachable check says nothing about the site's rules.

Evidence levels: Our Check is a direct read of the site's robots.txt, Company Document is confirmed by a quote, News Report is reported by a reputable outlet, and Unverified Lead never sets a verdict. Methodology v2.