Notes and rambles

The useful parts of the mess.

Field observations, build logs, and thoughts that earned a public URL.

01 / Notes

Field notes.

Short, canonical, and allowed to sound like a person.

  1. field note

    AI crawlers spend real budget on dead URLs

    Since 2026-07-31, one large content site in the measured fleet has returned 404 to 12,680 of 28,471 GPTBot requests. On this site, 109 of 135 ChatGPT-User requests did the same.

  2. field note

    When robots.txt and the edge disagree, the crawler loses

    A services site in the measured fleet permits Claude-SearchBot in robots.txt. Its edge rules have since refused 1,999 of that crawler’s requests with 401 or 403.

  3. field note

    robots.txt is a request, not a fence

    A local-services site disallows ClaudeBot in robots.txt. Since 2026-07-31, 60 of that crawler’s requests were served successfully anyway.

  4. build log

    SorcerAI needed a public record, not another agency page

    The old site sold generic automation while the actual work had moved into AI search, agent systems, QA, products, and a frankly unreasonable number of repositories.

  5. field note

    Proof is a data model, not a testimonial section

    A working repository, a private client outcome, a live product, and a complete specification are four different things. The site now says which one it means.

  6. ramble

    Repository volume is not a portfolio

    Owning a hundred repositories proves that GitHub permits poor impulse control. Curation proves judgment.