Agent Accepted

← Back to all companies

USA TodayUnited States

Submit correction

News · United States

Verdict
BlockedCovers all 5 agentsFrom technical signals only; no company statement found.
Company statement
None found
robots.txt signals
Blocked
Last checked
Fee
Unknown
x402
Unknown
Notes
Triaged automatically from the discovery queue; consumer classification and industry not yet human-reviewed.
Human verified
Not yet

By agent

AgentResultBasis
ChatGPTBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
ClaudeBlockedrobots.txt rule
PerplexityBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
GeminiBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
Meta AIBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
Meta MuseNo dataReported to send a generic Chromium-on-Linux user agent, so it cannot be targeted or detected via robots.txt; only company statements can speak to it.

Consumer surfaces

Evidence

Source typeAgentsResultEvidence levelObservedSource
robots.txt Check
Consumer agents
  • ChatGPT-User (the vendor says it may ignore robots.txt)
Search crawlers
  • OAI-SearchBot
  • PerplexityBot
Training crawlers
  • GPTBot
  • Google-Extended
Italic: the vendor says it may ignore robots.txt.		 Blocked Our Check2026-11-09 View source
11 rules
Disallow: /
Allow: /branded-story/
Allow: /contributor-content/
Allow: /story/branded-story/
Allow: /story/special/contributor-content/
Allow: /money/money-management/
Allow: /shopping/
Allow: /story/shopping/
Allow: /story/sponsor-story/real-estate-ausa/2026/04/16/sell-your-home-for-top-dollar-by-beating-back-to-school-deadlines/89482853007/
Allow: /story/sponsor-story/real-estate-ausa/2026/08/21/buy-now-or-wait-until-fall-tips-for-homebuyers-in-2026/91389661007/
… 1 more lines
robots.txt Check
Consumer agents
  • Claude-User
  • Perplexity-User (the vendor says it may ignore robots.txt)
  • Google-Agent (the vendor says it may ignore robots.txt)
  • Meta-ExternalFetcher (the vendor says it may ignore robots.txt)
Search crawlers
  • Claude-SearchBot
  • Amzn-SearchBot
  • Meta-WebIndexer
  • DuckAssistBot
Training crawlers
  • ClaudeBot
  • Applebot-Extended
  • CCBot
  • Amazonbot
  • Bytespider
Italic: the vendor says it may ignore robots.txt.		 Blocked Our Check2026-11-09 View source
Disallow: /
robots.txt Check
Training crawlers
  • Meta-ExternalAgent
 Blocked Our Check2026-11-09 View source
Disallow: /
Disallow: /

robots.txt checks

HostResultLast checkedUnchanged sinceContent-Signal
usatoday.comRead (200)2026-11-09 05:00 UTC2026-11-02None

A robots.txt with no agent-specific rules produces no result, and silence is not the same as allowed. A refused or unreachable check says nothing about the site's rules.

Evidence levels: Our Check is a direct read of the site's robots.txt, Company Document is confirmed by a quote, News Report is reported by a reputable outlet, and Unverified Lead never sets a verdict. Methodology v2.