Skip to content

Publish instruction-count baselines in README with a CI freshness gate - #7

Merged
tap merged 1 commit into
mainfrom
claude/icount-docs
Jun 11, 2026
Merged

tap merged 1 commit into
mainfrom
claude/icount-docs

Conversation

@tap

@tap tap commented Jun 11, 2026

Copy link
Copy Markdown
Owner

Closes a docs-promise gap found while auditing documentation: docs/PERFORMANCE.md stated that the deterministic instruction-count numbers would get the same marker-based README treatment as the wall-clock table "once PR B lands, and CI regenerates them to fail on drift" — PR B (#4) landed, but neither piece existed.

  • scripts/update_icount_docs.py renders a README table 1:1 from bench/baselines.json between <!-- ICOUNT:BEGIN/END --> markers (committed populated: the M55/Hexagon table including the headline 3.3× float-vs-Q15 inversion on Hexagon).
  • CI freshness gate: the icount-ratchet job regenerates the table and git diff --exit-codes it — since the table derives entirely from the committed baselines, the check is exact and free, and the published numbers provably cannot drift from the gated ones.
  • README Platform support now states that Hexagon and Cortex-M55 hot-path performance is CI-gated at ±3%.
  • docs/PERFORMANCE.md's "Docs freshness" section updated from promise to present tense.

No code changes; the table content is the already-reviewed baseline data.

https://claude.ai/code/session_01HuAFfoeD5a5Xe5aGNA16M9


Generated by Claude Code

docs/PERFORMANCE.md promised that the deterministic instruction-count
numbers would get the same marker-based README treatment as the
wall-clock table once the ratchet landed; deliver it.
scripts/update_icount_docs.py renders the table 1:1 from
bench/baselines.json, and the icount-ratchet job regenerates it and
fails on any diff, so the published numbers cannot drift from the
gated ones. The Platform support section now also states that Hexagon
and Cortex-M55 performance is CI-gated.
@tap
tap merged commit 5e5b687 into main Jun 11, 2026
22 checks passed
@tap
tap deleted the claude/icount-docs branch June 27, 2026 19:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants