Agent Accepted

← Back to all companies

Der SpiegelGermany

Submit correction

News · Germany

Verdict
BlockedCovers 2 of 5 agentsFrom technical signals only; no company statement found.
Company statement
None found
robots.txt signals
Blocked
Last checked
Fee
Unknown
x402
Unknown
Notes
Triaged automatically from the discovery queue; consumer classification and industry not yet human-reviewed.
Human verified
Not yet

By agent

AgentResultBasis
ChatGPTBlockedrobots.txt rule (advisory: the vendor says this agent may ignore robots.txt)
ClaudeBlockedrobots.txt rule
PerplexityNo dataNo data
GeminiNo dataGoogle documents Google-Agent for agents hosted on its infrastructure but does not name Gemini; the mapping is unconfirmed.
Meta AINo dataMeta's assistant. Meta documents this token for user-requested fetches but does not name Meta AI; the mapping is unconfirmed.
Meta MuseNo dataReported to send a generic Chromium-on-Linux user agent, so it cannot be targeted or detected via robots.txt; only company statements can speak to it.

Consumer surfaces

Evidence

Source typeAgentsResultEvidence levelObservedSource
robots.txt Check
Consumer agents
  • ChatGPT-User (the vendor says it may ignore robots.txt)
  • Claude-User
Search crawlers
  • OAI-SearchBot
  • Claude-SearchBot
Italic: the vendor says it may ignore robots.txt.		 Blocked Our Check2026-11-09 View source
9 rules
Allow: /ausland/
Allow: /partnerschaft/
Allow: /gesundheit/
Allow: /familie/
Allow: /reise/
Allow: /psychologie/
Allow: /stil/
Allow: /tests/
Disallow: /
robots.txt Check
Training crawlers
  • GPTBot
  • ClaudeBot
  • Applebot-Extended
  • CCBot
  • Meta-ExternalAgent
  • Bytespider
 Blocked Our Check2026-11-09 View source
Disallow: /

robots.txt checks

HostResultLast checkedUnchanged sinceContent-Signal
spiegel.deRead (200)2026-11-09 00:00 UTC2026-11-02None

A robots.txt with no agent-specific rules produces no result, and silence is not the same as allowed. A refused or unreachable check says nothing about the site's rules.

Evidence levels: Our Check is a direct read of the site's robots.txt, Company Document is confirmed by a quote, News Report is reported by a reputable outlet, and Unverified Lead never sets a verdict. Methodology v2.