https://sorcerai.co/notes/Aria Pramesi researches AI search, builds agent-native products, and publishes the evidence, systems, and field notes behind the work.en-usFri, 07 Aug 2026 21:20:00 GMT https://sorcerai.co/notes/ai-crawlers-spend-budget-on-dead-urls/https://sorcerai.co/notes/ai-crawlers-spend-budget-on-dead-urls/Fri, 07 Aug 2026 21:20:00 GMTSince 2026-07-31, one large content site in the measured fleet has returned 404 to 12,680 of 28,471 GPTBot requests. On this site, 109 of 135 ChatGPT-User requests did the same.https://sorcerai.co/notes/robots-txt-and-the-edge-disagree/https://sorcerai.co/notes/robots-txt-and-the-edge-disagree/Fri, 07 Aug 2026 21:05:00 GMTA services site in the measured fleet permits Claude-SearchBot in robots.txt. Its edge rules have since refused 1,999 of that crawler’s requests with 401 or 403.https://sorcerai.co/notes/robots-txt-is-a-request-not-a-fence/https://sorcerai.co/notes/robots-txt-is-a-request-not-a-fence/Fri, 07 Aug 2026 20:50:00 GMTA local-services site disallows ClaudeBot in robots.txt. Since 2026-07-31, 60 of that crawler’s requests were served successfully anyway.https://sorcerai.co/notes/sorcerai-needed-a-public-record/https://sorcerai.co/notes/sorcerai-needed-a-public-record/Sat, 01 Aug 2026 02:10:00 GMTThe old site sold generic automation while the actual work had moved into AI search, agent systems, QA, products, and a frankly unreasonable number of repositories.https://sorcerai.co/notes/proof-is-a-data-model/https://sorcerai.co/notes/proof-is-a-data-model/Sat, 01 Aug 2026 00:40:00 GMTA working repository, a private client outcome, a live product, and a complete specification are four different things. The site now says which one it means.https://sorcerai.co/notes/repo-volume-is-not-a-portfolio/https://sorcerai.co/notes/repo-volume-is-not-a-portfolio/Fri, 31 Jul 2026 23:05:00 GMTOwning a hundred repositories proves that GitHub permits poor impulse control. Curation proves judgment.