中文

This example presents public files collected on 2026-10-16 in our report format. MXDATA has no relationship with The Seattle Times. This is not legal advice.

Evidence report

seattletimes.com

Snapshot date
Panel rank
4,228 (Tranco Y8JGG, 2026-10-15)
Collection window
2026-10-16 07:18:55 UTC – 2026-10-16 07:19:02 UTC
Collector user-agent
MXDATA-signals/1.0 (+AI usage-rights signal archive; daily, low-rate; robots.txt respected)
Manifest SHA-256
7e5698…b1307e56985581858d76305bd18d7a9562b36950ef7a54c965acdbdc331615feb130

Signals recorded

SignalRecorded on 2026-10-16
AI crawlers fully blocked in robots.txt30 of 36 tracked crawlers

GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, anthropic-ai, Claude-Web, Claude-SearchBot, Google-Extended, Applebot-Extended, CCBot, PerplexityBot, Perplexity-User, Bytespider, meta-externalagent, FacebookBot, Amazonbot, cohere-ai, Diffbot, omgili, ImagesiftBot, Timpibot, YouBot, AI2Bot, DuckAssistBot, Google-CloudVertexBot, Meta-ExternalFetcher, PanguBot, Kangaroo Bot, cohere-training-data-crawler, Webzio-Extended

robots.txt wildcard * grouppartial block (selected paths)
Content Signalsnone recorded
RSL termshttps://www.seattletimes.com/rsl.xml
permits[usage]=search; prohibits[usage]=ai-all
ai.txtpresent with a full block
TDMRepnot found (404)
noai meta tag or response headernot found

Source files

robots.txt

HTTP status 200

https://seattletimes.com/robots.txt → https://www.seattletimes.com/robots.txt
Fetched at: · 3,168 bytes
SHA-256:

7301e8…baa07301e8b1bf3fc8c74af69731747eee3ccc6b80bcebf1a4fa4d4b28b5a1c3baa0

  1. # Seattle Times content is made available for your personal, non-commercial
  2. # use subject to our Terms of Service here:
  3. # https://www.seattletimes.com/notices/terms.html.
  4. # Use of any device, tool, or process designed to data mine or scrape the content
  5. # using automated means is prohibited without prior written permission from
  6. # The Seattle Times Company. Prohibited uses include but are not limited to:
  7. #the development of any software, machine learning, artificial intelligence (AI),
  8. # and/or large language models (LLMs).
  9. # Contact https://www.seattletimes.com/notices/copyright.html for assistance.
  10. License: https://www.seattletimes.com/rsl.xml
  11. Sitemap: https://www.seattletimes.com/?st-sitemap=index
  12.  
  13. User-agent: *
  14. Disallow: /cgi-bin
  15. Disallow: /st_above_fold_block/
  16. Disallow: /st_below_fold_block/
  17. Disallow: /81279359/
  18. Disallow: /DONOTMIGRATE/
  19. Disallow: /header.html
  20. Disallow: /footer.html
  21. Disallow: /life-top-stories/
  22. Disallow: /cap-ami-bentov/
  23. Disallow: /survey-confirmation/
  24. Disallow: /search/?similarto=
  25. Disallow: */page/
  26. Disallow: /wall-mobile/
  27. Disallow: /subscription/
  28. Disallow: /wp-json/
  29. Disallow: /wp-json-cached/
  30. Disallow: /wp-admin/
  31. Disallow: /*?attachment_id
  32.  
  33. User-agent: AI2Bot
  34. Disallow: /
  35.  
  36. User-agent: Amazonbot
  37. Disallow: /
  38.  
  39. User-agent: anthropic-ai
  40. Disallow: /
View remaining lines
  1.  
  2. User-agent: Applebot-Extended
  3. Disallow: /
  4.  
  5. User-agent: AwarioRssBot
  6. Disallow: /
  7.  
  8. User-agent: AwarioSmartBot
  9. Disallow: /
  10.  
  11. User-agent: Bytespider
  12. Disallow: /
  13.  
  14. User-agent: CCBot
  15. Disallow: /
  16.  
  17. User-agent: ChatGPT-User
  18. Disallow: /
  19.  
  20. User-agent: ClaudeBot
  21. Disallow: /
  22.  
  23. User-agent: Claude-SearchBot
  24. Disallow: /
  25.  
  26. User-agent: Claude-Web
  27. Disallow: /
  28.  
  29. User-agent: cohere-ai
  30. Disallow: /
  31.  
  32. User-agent: cohere-training-data-crawler
  33. Disallow: /
  34.  
  35. User-agent: DataForSeoBot
  36. Disallow: /
  37.  
  38. User-agent: Diffbot
  39. Disallow: /
  40.  
  41. User-agent: DuckAssistBot
  42. Disallow: /
  43.  
  44. User-agent: FacebookBot
  45. Disallow: /
  46.  
  47. User-agent: FriendlyCrawler
  48. Disallow: /
  49.  
  50. User-agent: Google-CloudVertexBot
  51. Disallow: /
  52.  
  53. User-agent: Google-Extended
  54. Disallow: /
  55.  
  56. User-agent: GPTBot
  57. Disallow: /
  58.  
  59. User-agent: ImagesiftBot
  60. Disallow: /
  61.  
  62. User-agent: Kangaroo Bot
  63. Disallow: /
  64.  
  65. User-agent: magpie-crawler
  66. Disallow: /
  67.  
  68. User-agent: Meta-ExternalAgent
  69. Disallow: /
  70.  
  71. User-agent: Meta-ExternalFetcher
  72. Disallow: /
  73.  
  74. User-agent: meta-externalfetcher
  75. Disallow: /
  76.  
  77. User-agent: MyCentralAIScraperBot
  78. Disallow: /
  79.  
  80. User-agent: NewsNow
  81. Disallow: /
  82.  
  83. User-agent: news-please
  84. Disallow: /
  85.  
  86. User-agent: NovaAct
  87. Disallow: /
  88.  
  89. User-agent: OAI-SearchBot
  90. Disallow: /
  91.  
  92. User-agent: omgili
  93. Disallow: /
  94.  
  95. User-agent: omgilibot
  96. Disallow: /
  97.  
  98. User-agent: Operator
  99. Disallow: /
  100.  
  101. User-agent: PanguBot
  102. Disallow: /
  103.  
  104. User-agent: peer39_crawler
  105. Disallow: /
  106.  
  107. User-agent: peer39_crawler/1.0
  108. Disallow: /
  109.  
  110. User-agent: PerplexityBot
  111. Disallow: /
  112.  
  113. User-agent: Perplexity-User
  114. Disallow: /
  115.  
  116. User-agent: Poseidon Research Crawler
  117. Disallow: /
  118.  
  119. User-agent: quillbot.com
  120. Disallow: /
  121.  
  122. User-agent: Quora-Bot
  123. Disallow: /
  124.  
  125. User-agent: Scrapy
  126. Disallow: /
  127.  
  128. User-agent: SeekrBot
  129. Disallow: /
  130.  
  131. User-agent: Slurp
  132. Crawl-delay: 10
  133.  
  134. User-agent: Timpibot
  135. Disallow: /
  136.  
  137. User-agent: TurnitinBot
  138. Disallow: /
  139.  
  140. User-agent: Webzio-Extended
  141. Disallow: /
  142.  
  143. User-agent: YouBot
  144. Disallow: /
  145.  
  146. User-Agent: AmazonAdBot
  147. Allow: /
  148.  

ai.txt

HTTP status 200

https://seattletimes.com/ai.txt → https://www.seattletimes.com/ai.txt
Fetched at: · 108 bytes
SHA-256:

9a2f1e…64069a2f1eb44eb8b8b495ef829b130263a6dfd93f05a1195e6c9ac9f712953f6406

  1. # Spawning AI
  2. # Prevent datasets from using the following file types
  3.  
  4. User-Agent: *
  5. Disallow: /
  6. Disallow: *
  7.  

tdmrep.json

HTTP status 404

https://seattletimes.com/.well-known/tdmrep.json
Fetched at: · 105,169 bytes
SHA-256:

99074b…ea0c99074b86b9106dcf740fc729df21c6ea93c42c54ce0fa66a54f0aeee800cea0c

No response body is included; only its hash was retained.

Homepage

HTTP status 200

https://seattletimes.com/ → https://www.seattletimes.com/
Fetched at: · 616,184 bytes
SHA-256:

92b615…445f92b615978c91355e588cd0ab42421ab624b9bb93c8730eefff61cb7714ea445f

Saved head meta/link tags; no AI-related tags found.

rsl.xml

HTTP status 200

https://www.seattletimes.com/rsl.xml
Fetched at: · 205 bytes
SHA-256:

05d083…ca1405d08322c38dedb4752b01629ed893ec92b64695cf1292958cf1c28f7f37ca14

  1. <rsl xmlns="https://rslstandard.org/rsl">
  2. <content url="/">
  3. <license>
  4. <permits type="usage">search</permits>
  5. <prohibits type="usage">ai-all</prohibits>
  6. </license>
  7. </content>
  8. </rsl>
  9.  

Verify this record

  1. Hash the file's exact bytes with SHA-256 and compare the result with the hash shown.
  2. Find that file hash in the day's response log. The log's hash is listed in manifest 7e56985581858d76305bd18d7a9562b36950ef7a54c965acdbdc331615feb130.
  3. Each manifest links to the previous day's manifest hash. Request the full chain if you need to trace those links.

Recorded changes

The record starts on 2026-10-16. A full report shows each detected change with the files before and after it.

Limits of this report

This report does not determine whether the signals are binding, whether any company complied with them, or which license terms the site would accept.

Need records for another site? Request a sample report.

Request a sample report