Agent Directory

← Back to all companies

BloombergUnited States

News · United States

Verdict
SelectiveCovers 3 of 5 agentsTechnical signals differ between agents (3 agents with a signal); no company statement found.
Company statement
None found
robots.txt signals
Selective
Last checked
Fee
Unknown
x402
Unknown
Notes
Triaged automatically from the discovery queue; consumer classification and industry not yet human-reviewed.
Human verified
Not yet

By agent

AgentResultBasis
ChatGPTConditionalrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
ClaudeConditionalrobots.txt rule
PerplexityNo dataNo data
GeminiNo dataGoogle documents Google-Agent for agents hosted on its infrastructure but does not name Gemini; the mapping is unconfirmed.
Meta AIBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
Meta MuseNo dataReported to send a generic Chromium-on-Linux user agent, so it cannot be targeted or detected via robots.txt; only company statements can speak to it.

Consumer surfaces

Evidence

Source typeAgentsResultEvidence levelObservedSource
robots.txt Check
Consumer agents
  • ChatGPT-User (the vendor says it may ignore robots.txt)
  • Claude-User
Search crawlers
  • OAI-SearchBot
  • Claude-SearchBot
Italic: the vendor says it may ignore robots.txt.		 Conditional Our Check2026-11-07 View source
21 rules
Disallow: /
Allow: /professional
Allow: /company
Allow: /latam
Allow: /faq
Allow: /tc
Allow: /$
Allow: /?bloomberg_debug=
Allow: /europe$
Allow: /europe?bloomberg_debug=
Allow: /europe/$
Allow: /europe/?bloomberg_debug=
Allow: /asia$
Allow: /asia?bloomberg_debug=
Allow: /asia/$
Allow: /asia/?bloomberg_debug=
Allow: /jp$
Allow: /jp?bloomberg_debug=
Allow: /jp/$
Allow: /jp/?bloomberg_debug=
Allo
robots.txt Check
Consumer agents
  • Meta-ExternalFetcher (the vendor says it may ignore robots.txt)
Training crawlers
  • Applebot-Extended
  • CCBot
  • Meta-ExternalAgent
  • Amazonbot
  • Bytespider
Italic: the vendor says it may ignore robots.txt.		 Blocked Our Check2026-11-07 View source
Disallow: /
robots.txt Check
Search crawlers
  • PerplexityBot
  • DuckAssistBot
Training crawlers
  • GPTBot
  • ClaudeBot
  • Google-Extended
 Blocked Our Check2026-11-07 View source
6 rules
Disallow: /
Allow: /professional
Allow: /company
Allow: /latam
Allow: /faq
Allow: /tc

robots.txt checks

HostResultLast checkedUnchanged sinceContent-Signal
bloomberg.comRead (200)2026-11-07 21:00 UTC2026-11-03None

A robots.txt with no agent-specific rules produces no result, and silence is not the same as allowed. A refused or unreachable check says nothing about the site's rules.

Evidence levels: Our Check is a direct read of the site's robots.txt, Company Document is confirmed by a quote, News Report is reported by a reputable outlet, and Unverified Lead never sets a verdict. Methodology v2. View as JSON