Claim ledger
Every number, date, status and quotation on this site, with its source, when it was read, how to re-derive it, and what it does not mean
Draft. Each row keeps its source and read time.
How to use this ledger
- Re-derive the automatable rows with
python3 tools/rederive.pyfrom the repository root. It needs no credentials, prints the recorded and the current value for each row, and printsUNREADwith a reason when a source cannot be read; an unread row is never reported as unchanged.--strictexits 1 on any change. - Read times are UTC, and each read cell states its row’s cadence: star counts, pull-request states and link checks 7 days, standards and project statuses 30 days, while published versions and dated events do not expire.
data/claim_cadence.tomlholds the cadence of every row. When a row’s read date plus its cadence has passed, this page marks the row stale as it loads. With scripts off, compare each read date with its cadence. - Captures. Every web page cited was saved when it was read. The capture log records URL, HTTP status, UTC time and SHA-256 for each one.
Each row’s identifier starts with the letter of the page it covers: A for the atlas, I for the home page, E for the experiments, P for the lab protocol, C for the project catalog, N for the agent incident record, and L for the site’s links. Rows that cite a local unpublished source say so; they are not independently reproducible until those exact source bytes are published.
Atlas
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| A-03 | WIMSE: active working group; seven working-group drafts, including an AI identity management draft | IETF Datatracker, WIMSE documents page | 2026-09-27 00:47 (30-day cadence) | open https://datatracker.ietf.org/wg/wimse/documents/ | Working-group drafts are not standards |
| A-04 | RFC 8693 is a Proposed Standard; OAuth 2.1 is a working-group draft | RFC Editor info page; Datatracker draft-ietf-oauth-v2-1 (revision 16) |
2026-09-27 00:47 (30-day cadence) | open both pages | Standards-track status, not deployment |
| A-05 | MCP authorization specification version 2026-07-28 states that authorization is optional | modelcontextprotocol.io, authorization page: “Authorization is OPTIONAL for MCP implementations” | 2026-09-27 00:47 (30-day cadence) | open the page | Applies to that specification version |
| A-45 | The OpenID Foundation writes that identity rooted in one infrastructure does “not naturally extend across organizations that do not share visibility or control over infrastructure” | OpenID Foundation, Identity Management for Agentic AI (October 2025), https://openid.net/wp-content/uploads/2025/10/Identity-Management-for-Agentic-AI.pdf; the full sentence gives an example in parentheses | 2026-09-27 01:50 (30-day cadence) | open the PDF and search the quoted clause | The foundation’s analysis of cross-organization identity, not a test |
| A-06 | Open Policy Agent: CNCF Graduated (2021); 12,297 stars | cncf.io; GitHub API | Status 2026-09-27 00:47; stars 2026-10-01 07:04:40 (7-day cadence) | rederive.py A-stars |
Maturity level and attention, not adoption or quality |
| A-07 | Kyverno: CNCF Graduated (2026-03-16); 8,206 stars | cncf.io; GitHub API | Status 2026-09-27 00:47; stars 2026-10-01 07:04:40 (7-day cadence) | rederive.py A-stars |
Maturity level and attention, not adoption or quality |
| A-09 | agentgateway: a Linux Foundation project, per its README; 5,111 stars | the project’s README; GitHub API | Status 2026-09-27 00:56; stars 2026-10-01 07:04:40 (7-day cadence) | rederive.py A-stars |
Foundation status is the project’s own statement; the CNCF project URL returned 404 |
| A-stars | Every GitHub star count on the atlas (25 entries that name a repository) | GitHub API repos/<owner>/<repo>; native CI readout |
2026-10-01 07:04:40, recorded as stars_read in data/atlas.toml (7-day cadence) |
python3 tools/rederive.py reads every entry with a repo in data/atlas.toml; python3 tools/refresh_stars.py rewrites them all with one read time |
Stars measure attention, not quality or use |
| A-16 | OpenTelemetry: CNCF Graduated (2026-05-11); generative-AI and agent-span conventions marked “Development” | cncf.io; the conventions’ own Markdown in open-telemetry/semantic-conventions-genai |
2026-09-27 00:47; 00:51 (30-day cadence) | open both | “Development” is the conventions’ own stability label |
| A-18 | in-toto: CNCF Graduated (2025-02-10); attestation specification v1.2 | cncf.io; the specification README (“Latest version: v1.2”) | 2026-09-27 00:47; 00:49 (30-day cadence) | open both | Maturity level and a specification version, not adoption |
| A-19 | Sigstore: an OpenSSF project | openssf.org project list | 2026-09-27 00:52 (30-day cadence) | open the openssf.org project list | The OpenSSF page read does not show a maturity stage |
| A-20 | RFC 9943 and RFC 9942: Proposed Standards, June 2026 | IETF Datatracker, SCITT documents page | 2026-09-27 00:47 to 00:52 (does not expire) | open the page | Standards-track status, not deployment |
| A-21 | C2PA: a Joint Development Foundation project; specification 2.4 current | spec.c2pa.org specifications index | 2026-09-27 00:49 (30-day cadence) | open the page | Governance and a version, not adoption |
| A-22 | RFC 9162: Experimental (2021) | RFC Editor | 2026-09-27 00:47 (does not expire) | open https://www.rfc-editor.org/info/rfc9162 | Experimental status, as the RFC itself states |
| A-23 | RFC 8785: Informational | RFC Editor | 2026-09-27 00:47 (does not expire) | open https://www.rfc-editor.org/info/rfc8785 | Informational status; it defines no requirement |
| A-24 | Inspect: developed by the UK AI Security Institute and Meridian Labs | inspect.aisi.org.uk | 2026-09-27 00:47 (30-day cadence) | open the page | Authorship as the project states it |
| A-25 | METR: a research nonprofit that measures whether and when AI systems might pose catastrophic risks | metr.org/about: “a research nonprofit that scientifically measures whether and when AI systems might threaten catastrophic harm to society” | 2026-09-27 00:47 (30-day cadence) | open the page | Paraphrased on the atlas; quoted here |
| A-26 | NIST CAISI runs an AI Agent Standards Initiative | nist.gov/caisi and the initiative page | 2026-09-27 00:47; 00:54 (30-day cadence) | open both | The program’s existence, not its output |
| A-27 | MLCommons AILuminate covers 12 hazard categories | mlcommons.org/ailuminate: “assesses genAI across 12 hazard categories” | 2026-09-27 00:47 (30-day cadence) | open the page | The benchmark’s scope as its publisher states it |
| A-28 | OWASP AI Testing Guide: version 1 published November 2025 | the project page: “Version 1 Published”, 26 November 2025 | 2026-09-27 00:47 (does not expire) | open the page | An OWASP Incubator project |
| A-29 | CEN-CENELEC lists the AI Act harmonised standards as under development | cencenelec.eu AI topic page: “Key Standards Under Development” | 2026-09-27 00:47 (30-day cadence) | open the page | The JTC 21 dashboard returned HTTP 500 and supports nothing here |
| A-30 | EU AI Act: in force; consolidated version of 27 July 2026 | EUR-Lex: “In force … Current consolidated version: 27/07/2026” | 2026-09-27 00:47 (30-day cadence) | open the EUR-Lex page | Legal status and the consolidated text’s date; applicability dates differ by article |
| A-31 | NIST AI RMF 1.0: voluntary; under revision | nist.gov: “intended for voluntary use”; “being revised” | 2026-09-27 00:47 (30-day cadence) | open the page | Status as NIST states it |
| A-32 | NIST AI 600-1 published July 2024 | nist.gov publication page (2024-07-26) | 2026-09-27 00:47 (does not expire) | open the page | Publication date only |
| A-33 | California SB 53: Chapter 138, Statutes of 2025 | leginfo.legislature.ca.gov bill status | 2026-09-27 00:47 (does not expire) | open the page | Enactment, not enforcement |
| A-34 | AEF-1: minimum operating conditions for independent third-party evaluation, version 1 | aievaluatorforum.org: “Version 1, updated December 4, 2025” | 2026-09-27 00:58 (30-day cadence) | open the page | The document’s own scope; signatories are not verifiers |
| A-35 | OWASP Top 10 for Agentic Applications: 2026 edition, December 2025 | genai.owasp.org resource page, dated 9 December 2025 | 2026-09-27 00:47 (does not expire) | open the page | An edition and its date, not adoption |
| A-36 | Agentic AI Foundation: announced December 2025; working groups include identity and trust, and observability and traceability | Linux Foundation press release (2025-12-09); aaif.io | 2026-09-27 00:47 (30-day cadence) | open both | Announced structure, not output |
| A-37 | My vocabulary, conformance corpus and admission rules, and two Rust crates | GitHub; crates.io | 2026-09-27 00:44 (30-day cadence) | open each link on the atlas | Existence and placement, not use by others |
| A-38 | Current releases: vocabulary v0.3.0; vectors v0.16.0; admission no tags; jcs-admit and dsse 0.1.1. Historical v0.13.0 baseline: 817 vectors in 13 corpora | GitHub tags; PyPI; crates.io; native CI readout; original 13 MANIFEST.json files at v0.13.0 |
Current releases 2026-10-01 07:04:40; historical vector total 2026-09-27 01:16 (30-day cadence) | rederive.py A-38a to A-38f |
Current release versions and the historical tagged corpus census are separate measurements; the old count is not a v0.16.0 total |
| A-38q | Quotations “These rails evaluate an already-verified statement. They do not verify one.” and “Implements the envelope and nothing else” | the agent-evidence-admission and dsse READMEs, main branch (commits 1ded5b8 and 83e0477) | 2026-09-27 00:44 (30-day cadence) | read each README | Quoted from each README at the read time; a README can change |
| A-39 | Three contributions and their states: two pull requests open and unmerged, and one individual Internet-Draft, as listed on the atlas | GitHub API for each pull request; IETF Datatracker for the draft | 2026-09-27 00:41 to 00:42 (7-day cadence) | rederive.py A-39d and A-39f; Datatracker page for the draft |
“Open” says nothing about the likelihood of merge |
| A-41 | The one-line description of each named project | each repository’s own GitHub description, paraphrased; foundation membership from the project’s site or README | 2026-09-27 01:31 (30-day cadence) | gh api repos/<owner>/<repo> --jq .description |
Paraphrase; the repository’s wording governs |
| A-42 | The mechanism table’s “writer” column (self, peer, external) | the atlas’s own classification, using the witness-scope terms of agent-evidence-vocabulary | 2026-09-27 (does not expire) | read data/atlas.toml |
A reading of a typical deployment, stated as such on the page; a given deployment can differ |
| A-43 | Corpus member counts and splits (275; 232; 61; 52; 34; 34; 32; 27; 26; 15; 13; 8; 8) | each corpus’s MANIFEST.json at tag v0.13.0 |
2026-09-27 01:16 (does not expire) | rederive.py A-38c for the total; git show v0.13.0:<corpus>/MANIFEST.json for each |
Counts at the tag, not on the main branch |
| A-46 | Signature and canonicalization rows link APS/PriorSeal limits, six AGT byte cases, and the pinned observer consumer admission/replay | data/atlas.toml; experiment records E-05 through E-13 |
2026-10-01 (does not expire) | Generate the atlas; reproduce E4, E5 and E6 as documented in experiments.html |
Pinned fixture experiments, not new family entries, production measurements, or independent custody |
| A-44 | OECD.AI catalogue listing; W3C mailing-list post of 12 September 2026 | the two pages, captured | 2026-09-27 01:23 (30-day cadence) | open both | A listing is not an endorsement |
| A-40 | None is merged or adopted as of the read | the same reads | 2026-09-27 00:42 (7-day cadence) | the same | Merge state only; a merge would not be adoption |
Home page
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| I-01 | Three Jobs, Not One: Zenodo version 6, published 14 August 2026 | Zenodo API, record 21935891 | 2026-09-27 01:16 (does not expire) | rederive.py I-01 |
The deposit’s version, not a peer-review status |
| I-02 | GEM 2026 paper by Sankalp Gilda and Shlok Gilda | Crossref, DOI 10.18653/v1/2026.gem-main.80 | 2026-09-27 01:10 (does not expire) | curl https://api.crossref.org/works/10.18653/v1/2026.gem-main.80 |
Publication, not reception |
| I-03 | The atlas names 45 projects and standards and 18 mechanisms | python3 tools/gen_atlas.py, which prints the counts |
2026-09-27 17:09 (does not expire) | the same command | Counts of named entries, not of the field |
| I-04 | Current releases: vocabulary v0.3.0; vectors v0.16.0; admission no tags; jcs-admit and dsse 0.1.1. Draft/published labels retain their original reading | Releases as A-38; labels in data/atlas.toml |
Releases 2026-10-01 07:04:40; labels 2026-09-27 11:49 (30-day cadence) | rederive.py A-38 |
A label is this site’s reading, not a maturity rating; release refresh does not re-audit the label |
| I-05 | Versions, dates and statuses of the site’s own artifacts | data/versions.toml, rendered on the version ledger page |
2026-10-01 (does not expire) | read the file | The site’s own record of itself |
| I-06 | The claim ledger’s rows are re-checked on every weekly re-derive | .github/workflows/site.yml, job rederive, schedule 17 6 * * 1 (Mondays 06:17 UTC), running python3 tools/rederive.py --unread-fails |
2026-09-27 19:29 (does not expire) | read the workflow file | Only the automatable rows are re-read; rows whose re-derive is a procedure are checked by hand |
| I-07 | Experiment draft 0.3 retains the PEER pilot, APS/PriorSeal and AGT results, and adds source-pinned observer admission/replay; two designs have no qualifying independent result; three other pieces remain held | src/experiments.md; recorded outputs; data/versions.toml |
2026-10-01 (does not expire) | Reproduce each measured record by its pinned procedure, including the observer CI gate | Author-produced fixtures and byte checks do not establish independent custody or production usage |
| I-08 | The home page states the proposed action-assurance consumer contract; no end-to-end conformance is claimed | src/index.md |
2026-09-29 (does not expire) | read the action-assurance section | Component corpora and the local PEER pilot do not establish this full contract |
Experiments
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| E-01 | Three scripted intervals: brokered write one accepted and one replay, offline verified at PEER; durable direct bypass succeeded and produced a known gap; transient direct bypass succeeded, was removed before snapshot, and produced knownGaps=[] and noDetectedGap=true |
experiments/observer-vantage/recorded.json from run.py against local agent-evidence-observer source |
2026-09-29 16:45 (does not expire) | Run the exact command in experiments.html with observer source digest E-02, then diff -u the result |
Local scripted counterexample, not a live agent or a detection rate; no independent rerun until the package source is public |
| E-02 | The pilot used observer package metadata and Python sources with SHA-256 273e4985cb4de671145bcd55ef85545be213e8520f766ab7692e9d05edae60d1 |
source_digest() in experiments/observer-vantage/run.py; recorded JSON |
2026-09-29 16:45 (does not expire) | Run run.py --observer-root as in the experiment page and compare observerSourceSha256 |
Source tree is local and unpublished at this read; a digest makes a later comparison possible but cannot supply the bytes |
| E-03 | The pilot’s two signing keys were held by one process; there were zero isolated-agent and zero separately operated witness runs | The pilot script, the local observer README.md, and src/experiments.md |
2026-09-29 16:45 (does not expire) | Inspect make_interval() in the pilot and the E2/E3 sections; request external run evidence before promoting a claim |
A tested key distinction is not an operator or privilege boundary; the zero counts describe this pilot only |
| E-04 | E2 and E3 are registered designs without result or overhead measurement | src/experiments.md sections E2 and E3 |
2026-09-29 16:45 (does not expire) | Inspect the designs and the version ledger’s draft status; later compare raw run bundles and deviations with this source digest | Registration fixes a proposed protocol; it does not validate its feasibility or claim independent evidence |
| E-05 | APS/PriorSeal E2 has 96 claim/input rows: 86 pass, four fail, six not-exercised; the fetch script pins 31 input files | RESULTS.json and adjacent fetch_inputs.sh | 2026-09-30 (does not expire) | Check out vectors 00f5acab880bffc5ee8fe124f3a015d3ed970514 and run the pinned README commands; count rows by state | Fixtures at a fixed reference time; the counts are not a deployment success rate |
| E-06 | Both payment cases correlate to the APS decision_ref; the over-limit observation fails the exact-call value and per-action cap; 22 recomputed report values and three quoted values agree | The E-05 result and adjacent DISAGREEMENTS.md, pins.json and SPEC-GAPS.md | 2026-09-30 (does not expire) | Recompute E-05; inspect the named comparison and report rows | Asset mapping and two hash constructions are the checker’s documented readings; PriorSeal signature assertions remain unexercised |
| E-07 | Seven negative/control records include a rehashed authorization that survives at the unexercised PriorSeal-signature target; its APS requested_call cross-check fails | NEGATIVES.json, build_and_run.py and SPEC-GAPS.md | 2026-09-30 (does not expire) | Run the pinned mutation procedure and inspect targetedFlips, changed states, and the two controls | Not whole-case acceptance; no chain execution, live currency or revocation, decision-level single use, cumulative spend, independent custody, or production usage is established |
| E-08 | AGT transcript experiment pins source at 60931ce0c65db144032cdc8e8f342c66cbb1201c and the RFC 8785 oracle at 655cbe02b8761208e3f4cc49e879ab1e328a7dca; Python 3.12.14 and Pydantic 2.13.5 | runner and recorded result | 2026-09-30 (does not expire) | Run the E5 command; source Git blob IDs must match before import; compare the result byte for byte | Calls real AuditEntry and mapper code with fixed inputs; no signed record or live agent execution |
| E-09 | Six selected inputs: ASCII agrees across both AGT mappers and RFC 8785; non-ASCII values split the mappers; UTF-16 ordering and three numeric cases disagree with RFC 8785 in both | E-08 recorded cases and pinned trace_model.py/trace_sink.py source | 2026-09-30 (does not expire) | Reproduce E-08 and inspect each digest and agreement flag | A transcript-byte result for the pinned implementation, not a claim about all TRACE adapters, production failures, effect capture, or custody |
| E-10 | Observer source revision 8562c25fb7ec97596ea9d0297c495340298914b6 is bound by 12 exact Git blob pins; experiment runtime is Python 3.12.14 and cryptography 46.0.7 | Source pins, runner and recorded report | 2026-10-01 (does not expire) | Run E6; every source blob must match before private-copy import | Real pinned demo and admission code; same-operator fixture, no live agent or independent custody |
| E-11 | Original admission artifact 11138571560 from successful PR run 36808961399 has archive SHA-256 bcc22cd27b1f9404e961f7329770620994a76348d085b7b711ab586986493892; its job passed 148 tests, demo and eight boundary-probe checks | CI run, retained file manifest and provenance | 2026-10-01 (does not expire) | Check run logs and artifact digest; run E6 with --manifest to check every retained file |
PR head cc7191e and synthetic checkout e8040a8 have the pinned tree; additional native main run 36825509807 checked out 8562c25 and passed the same checks. Both are author-produced, not independent operation |
| E-12 | One declared broker effect leads to one durable consumer admission and two witness receipts; replay, changed consumer authority and altered signed claim refuse with exact reasons; all refusals preserve consumer state | Recorded result, retained policy, packet, history, receipt log, effect, decision and state | 2026-10-01 (does not expire) | E6 re-admits the original bundle, compares decision/state bytes, exercises three controls in appropriate stores, then requires a fresh demo to match | Local at-most-once admission; no exactly-once application effects, wall-clock freshness, complete capture or cross-host consensus |
| E-13 | Observer demo and atlas replay remain PEER/artifact and author-produced same-operator fixtures; unmediatedEffects is not-established | E-10 through E-12, pinned consumer contract, E6 limits | 2026-10-01 (does not expire) | Inspect source, retained fixture pins and report scope; require external operator evidence before promotion | Different directories and signing keys do not establish separate operation or custody; consumer-state rollback can erase replay protection |
Open Evidence Lab
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-01 | Protocol 0.1.1 has one initial E6 record, a run form and correction form; artifact hashes and measured JSON-pointer bindings are checked before build | Lab, register, tools/check_lab.py and .github/ISSUE_TEMPLATE/ |
2026-10-01 (does not expire) | python3 tools/check_lab.py; inspect forms and build job |
Owned submission protocol and retained fixture record; no external members, host adoption, certification or independent custody is established |
| P-02 | AAIF PR #60 at 99d72c8484ac82f2c7128f2cb3b09e2971f8f234 proposes agree/evidence/interpret/contribute phases and an observed-gap register | Pinned execution-plan proposal | 2026-10-01 (does not expire) | Read the pinned plan and PR #60 review state | A cited proposal informs this owned protocol; it supplies no AAIF commitment to the lab |
| P-03 | Gemara PR #507 at a3016f4ddadda4e2d4a68ab353ce430fdb62b6bf specifies full delivered-octet digests, SHA-256 support and citation-integrity outcomes verified/integrity-failure/unverifiable | Pinned evidence.cue | 2026-10-01 (does not expire) | Inspect #Digest and source mapping comments | Proposed raw-byte integrity contract; no completed lab adapter result, Gemara adoption or effect/custody claim |
| P-04 | PR #5’s pinned source replay checks 17 owner/copy files, reports 14 established, 3 contradicted, 5 not established claims, and refuses substituted copy, missing owner, omitted flag and stale report | Pinned runner, procedure and recorded outcomes; CI run 36910480718 | 2026-10-01 (does not expire) | Run the pinned procedure from fresh source checkouts; compare the 22 claim results and five cases with recorded.json |
Frequency’s unmodified review adapter on public fixtures, with known expected outcomes; no mutation adequacy, live effect, independent custody or formal acceptance |
| P-05 | PRs #5 and #6 merged on 1 October; APS, PriorSeal and Frequency owner confirmations are not recorded in Probity’s proposed pilot page | PR #5; PR #6; pilot status | 2026-10-01 (7-day cadence) | Check the merged PR states and the pilot page’s owner confirmation links at the next review | This is Probity’s work status, not a claim that no external conversation exists |
| P-06 | Frequency’s pinned capsule carries a review-only notice that withholds commercial incorporation and redistribution of modified or derivative implementations | Pinned notice | 2026-10-01 (does not expire) | Inspect the pinned notice; any later permission needs its own evidence | Technical reproduction by reference is separate from a commercial license or shared-schema grant |
| P-07 | At Frequency review revision b12879d, the pinned wrapper records zero and prints PASS when stubbed Node fails, npm install fails, or no report is written | Probity’s run-contract control and pinned wrapper | 2026-10-01 (does not expire) | Run check-run-contract.mjs against the pinned clean checkouts; inspect all three recorded exits and absent reports |
Stubbed commands, not an adapter verification or a claim about later wrapper revisions; Probity’s direct runner requires a fresh report |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-08 | REMORA E7 submission reproduces all five frozen fixture outcomes with a separate reader at a0b8917; global completeness stays NOT_ESTABLISHED | Report, native record, provenance | 2026-10-02 (does not expire) | python3 tools/check_lab.py; replay pinned reader and compare case results |
Native external-operator independence only; no independent effect custody or host adoption |
| P-09 | JEP Core 0.7 submission passes 25 validation, four producer and eight acceptance assertions at dd76a53 | Report, preregistered protocol, provenance | 2026-10-02 (does not expire) | python3 tools/check_lab.py; replay pinned reader against source-lock |
Exposed answers; synthetic local effects; selected manifest only |
| P-10 | REMORA seven-day review opened October 2, 2026 at 17:04:37 UTC and ends October 9 at 17:04:37 UTC; JEP implementation submitted; neither establishes host CI adoption | REMORA submission, JEP report and retained provenance | 2026-10-02 (7-day cadence) | Read submission timestamp, add seven days, inspect producer replies and host-owned workflow before promotion | Review is open, not completed; JEP awaits producer response; actual outputs are unchanged |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-11 | LangGraph durable reader reconstructs six cases; crash-after-effect recovers at revision one; pending intent stays incomplete and missing checkpoint/wrong thread refuse | Exact report, original ZIP and member digests; Observer native run37045346741 at90cd62c | 2026-10-02 (does not expire) | python3 tools/check_lab.py; inspect /records/2 through /records/5 in the retained report and replay the pinned native reader |
Author-owned worker hard exit/reopen; target remains alive; no power loss, general exactly-once or independent custody |
| P-12 | Pydantic v1 reconstructs seven attempts; exhausted retry retains error/no effect and committed-effect failure retains error with revision one | Exact report, original ZIP and member digests; native run37044768724 atafda549 | 2026-10-02 (does not expire) | python3 tools/check_lab.py; inspect /plannedAttempts, /records/5 and /records/6, then replay the pinned reader |
Author-owned real framework with scripted FunctionModel; no model-quality result, outside recurring use or independent custody |
| P-13 | Actual-weight microtask run scores all48 attempts, zero correct and two format-valid over four families and two output limits; evidence complete and within run budget | Unmodified reader report, provenance; run37044646302 atab84161 | 2026-10-02 (does not expire) | python3 tools/check_lab.py; sum correct and formatValid over report quality, inspect population, evidence, family/configuration values |
Author tasks/answers exposed; fixed order confounds warmup; not a representative benchmark or live decision effect. CPU is whole-process delta and RSS lifetime peak |
| P-14 | Public native framework retention is byte-exact; the model retention is a selected derivative of original274795286-byte ZIP, excluding weights/binaries and naming every member/digest/selection | LangGraph provenance, Pydantic provenance, model selection | 2026-10-02 (does not expire) | python3 tools/check_lab.py; verify report member bytes and every retained member digest against provenance in tests/test_retained_native_runs.py |
Full model ZIP remains local/provider-retained and can expire; derivative alone does not rerun inference or authenticate omitted source bytes. All records remain Probity-operated |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-15 | Authority recovery retains eight cases/sixteen native workers; six invalid recoveries make no recovery dispatch while earlier after-effect revisions remain one | Exact-main report, original/member provenance; Observer run 37054238335 at b02988a | 2026-10-02 19:38 UTC (does not expire) | python3 tools/check_lab.py; inspect all eight /records with freshRecoveryDispatches, recoveryAuthority and retainedNativeRevision |
Deterministic host-selected recovery clock, separate signed target grant; target alive; same operator; no independent custody |
| P-16 | Target recovery retains seven cases/fourteen processes, three completed effects/two incomplete/two startup refusals; eight-request overlap has one 200 and seven 409 responses | Exact-main report, original/member provenance; run 37053794133 at 37d1dd4 | 2026-10-02 19:38 UTC (does not expire) | python3 tools/check_lab.py; inspect top-level counts and count statuses in /records/4/dispatchResponses |
PIDs unsigned runner testimony; native SQLite/key/clock/HTTP author controlled; no power loss, universal exactly-once or outside use |
| P-17 | Paired actual-weight run scores 96/96 under 16 rows; 135M strict 0/48, format 2/48; 360M strict 8/48, format 42/48; each cap’s 360M rows strict 2/6, 1/6, 1/6, 0/6 | Unmodified native report, protocol/source/member provenance; run 37053301748 at b7db63c | 2026-10-02 19:38 UTC (does not expire) | python3 tools/check_lab.py; group report quality by model, retain each configuration/family, sum correct, formatValid and scored within each named model |
Exposed authored expectations, declared blocked interleaving/cache reset; no benchmark estimate, model retuning, inference retries, live effects or independent operation; resource scopes stay labelled |
| P-18 | Actual OpenAI Agents SDK retains six cases, nine scripted Model calls/six tools/three signed effects; task statuses three complete/two error/one incomplete; no model-quality evaluation | Original report, producer/synthetic/reader/target revisions and members; run 37053806564 | 2026-10-02 19:38 UTC (does not expire) | python3 tools/check_lab.py; inspect /resources, count taskStatus and revision-one cases in /records, inspect /modelQuality |
Native SDK with scripted Model; no remote inference, independent target custody or outside recurring adoption |
| P-19 | Four continuation archives are byte-exact original provider artifacts; model compact 246 members map to full 276 members with 30 explicit omissions; full 465338754-byte preparation remains private/provider-retained | Authority, target, model, SDK | 2026-10-02 19:38 UTC (does not expire) | Verify every retained member and report with tests/test_retained_native_runs.py; verify full-preparation mapping/omissions in continuation controls |
Original compact is not full preparation; omitted weights/wheels cannot be reconstructed from hashes; provider archive may expire; no custody transfer |
| P-20 | Native paired-model preparation history retains initial no-inference failure 472190754 bytes and corrected 472221945 bytes, cumulative 944412699 across two 512 MiB selections; no inference retried | Native preparation report and complete acquisition provenance, report | 2026-10-02 19:38 UTC (does not expire) | Inspect preparationHistory, original source receipts and frozen protocol; add the two named response-body totals |
Cumulative history is not a single 512 MiB acquisition; observed successful native report covers corrected preparation only |
| P-21 | Register contains ten retained records; twelve new archive/provenance/report files published at Atlas 55df577 before continuation indexing; native output/comparison exposure remains explicit | Register, raw retention commit 55df577, original provenance files | 2026-10-02 19:38 UTC (does not expire) | python3 tools/check_lab.py; inspect commit tree and each continuation atlasRevision/comparisonOrder |
Atlas raw publication before indexing does not make native measurement blind or raw-result-first; ten records do not mean ten outside adopters |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-22 | Native ExecSurface state join retains one carried write and a separate nine-byte endpoint snapshot; predicate valid/native complete while scopeComplete false and typed health unknown; producer PASS stays outside the signed interval | Exact-main report, original archive/source/member provenance; run 37055671392 at 88f475d | 2026-10-02 19:52 UTC (does not expire) | python3 tools/check_lab.py; inspect carriedWrites, companionAfterBytes, predicateVerdict, nativeComplete, scopeComplete, collectionHealth, nativeWriteByteCount, producerComparisonOutsideInterval |
Voluntary/peer/log-import/software-only; metadata carries no write bytes/count; endpoint snapshots do not exclude intermediate writes; same-operator key/clock/capture; no independent custody or outside adoption |
| P-23 | Original state-join archive 743420 bytes retains 29 members and eighteen selected interval files; adding this record preserves ten prior entries/archives and brings register total to eleven | Member provenance, register, report | 2026-10-02 19:52 UTC (does not expire) | python3 tools/check_lab.py; exact archive/report member check in tests/test_retained_native_runs.py; count register records and compare preceding committed entries |
Integrity/indexing only; native output/comparison emitted together, not blind; retain producer calibration apart from signed interval |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-24 | Actual-weight paired format control scores all192 attempts in32 separate model/cap/decoder/family rows; all96 constrained outputs are JSON/schema-valid; exact eight grouped rows preserve32 underlying families and larger-model policy1/6 at each cap | Original report, provenance at native source75797cb/run37056945285 | 2026-10-02 20:17 UTC (does not expire) | python3 tools/check_lab.py; group report quality by model/configuration/decoder and inspect correct/formatValid/schemaValid; selected semantic mutation controls in tests/test_retained_native_runs.py |
Complete schema validity is not typed-exact correctness or approval to execute model decisions; exposed authored finite tasks, not representative benchmark or external custody |
| P-25 | Protocol/compiler/24 grammar hashes frozen before inference; syntax/type-only constraints without target constants/enums/patterns, max16 integer digits/one optional ASCII space/fixed required-key order | Preregistration108887b, original protocol/compiler/grammars in archive, protocolPreregistration in provenance | 2026-10-02 20:17 UTC (does not expire) | python3 tools/check_lab.py; compare protocol SHA, compiler SHA and all24 grammar hashes against original members |
Selected grammar restrictions limit generalization; preregistration/source hashes do not establish independent operation or no task exposure |
| P-26 | Original compact archive2326615 bytes has463 native members, mapped exactly to493 full preparation members with30 explicit omissions; current acquisition472221945 response-body bytes and four-preparation cumulative1694784417 bytes; total twelve records preserving eleven earlier entries/archives | Original member/full-preparation provenance, report, register | 2026-10-02 20:17 UTC (does not expire) | python3 tools/check_lab.py; original/full mapping and reselected fault controls in tests/test_retained_native_runs.py; sum four preparation history fields and compare baseline register/artifacts |
Four separate512MiB preparation envelopes; cumulative acquisition exceeds one envelope; full weights/source/wheels/preparation originals private, not independently reconstructible from compact ZIP; no retries/retuning or outside recurring adoption |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-27 | Twelve actual GoogleADK scripted reference cases:25 scriptedBaseLlm calls/18 tools/9 HTTPposts/7 native effects/43 native events;7 tasks complete/4 error/1 incomplete; after-effect error and early close retain committed revision | Original ADK report, source/member provenance, original run37058694970 | 2026-10-02 20:30 UTC (does not expire) | python3 tools/check_lab.py; sum report resources/records nativeRevision/nativeEvents and taskStatus; execution semantic controls in tests/test_retained_native_runs.py |
Scripted nativeBaseLlm is not remote inference/model quality; typedMCPisError viaFunctionTool is not MCPtransport; sameoperator fixture/key/clock/store; no outside acceptance/recurring use or independent custody |
| P-28 | ADK original artifact2638638 bytes retains838 members; sourcea6cb0b0 synthetic, implementationbd623b3, reviewed420a96a, separatetarget4a50e61 and mergedc774e07 retained distinctly; later exactmainrun37059471560 verified without overwriting first measurements | ADK original archive, provenance, recorded-run.json in source profile | 2026-10-02 20:30 UTC (does not expire) | python3 tools/check_lab.py; exact retained archive-member tests; inspect source/reader/implementation/target and exactMainVerification fields |
Original and later main runs are separate; member/source hashes establish retained byte identity, not independent execution/custody or universal callback coverage |
| P-29 | Actual framework-free installed0.0.2→0.0.3 upgrade: old format refused; candidate format evidence verified/bounded report publish; separate selected schema-policy hold for two rows1/6 against hostminimum3; source mutant held; original2268 members retained without omission, including3 wheels; fourteen record total preserving twelve earlier entries/artifact bytes | Original installed upgrade report, complete archive/provenance, register | 2026-10-02 20:30 UTC (does not expire) | python3 tools/check_lab.py; inspect baseline/candidate versions, modules, gate evidence/publication states, policyFailures, preservedReports; selected execution/SHA-reselection mutation controls |
Host-authored selected policy minimum, not a universal safety threshold; no new inference, protected dispatch/recovery, registry release, outside acceptance/recurring use or independent custody; original native192 producer run remains separate |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-30 | Boundary original scores384 attempts in24 separate rows; all192 constrained outputs schema-valid; per cap constrained135M typed16/16,policy0/16,grounded3/16 and360M typed13/16,policy2/16,grounded1/16; no policy/grounded pair fully correct; table retains8 grouped configurations,16 cases/8 pairs per family | Original report, finite finding, native source6cfd28d/run37060702246 | 2026-10-02 21:15 UTC (does not expire) | python3 tools/check_lab.py; python3 tools/derive_boundary_findings.py --check; inspect all24 quality rows and192 pair records |
Exposed finite authored population,48 identities/46 literal inputs including two repeated positive controls; unchanged typed-exact scores, no general benchmark or model-action approval |
| P-31 | Original cap comparisons preserve96/96 identical constrained texts/verdicts and41/96 identical unconstrained texts with82/96 identical verdicts; larger constrained model fails empty-list,string-null,empty-string at both caps | Finite findings, exact attempts/targets in original archive | 2026-10-02 21:15 UTC (does not expire) | python3 tools/derive_boundary_findings.py --check; compare original short/long attempt IDs/output text and all six constrained typed failure pointers |
Descriptive same-run comparisons, not a general causal cap effect; output whitespace retained, no score retuning |
| P-32 | Post hoc case-sensitive7-label policy diagnosis: each constrained135M cap has16 outside-vocabulary,0 valid-but-wrong,0 strict-correct;360M each cap9 outside,5 valid-but-wrong,2 strict-correct; vocabulary intervention remains unexecuted | Finite finding, reproducible readout | 2026-10-02 21:15 UTC (does not expire) | python3 tools/derive_boundary_findings.py --check; inspect policyVocabularyDiagnostic and original attempt references |
Disclosed post hoc diagnostic only; membership does not alter original strict correctness or establish policy decision acceptance; enum intervention requires new source/freeze/reader review |
| P-33 | Original resources257.401173568s wall/497.394631919s total process CPU;496.051239620s returned-call CPU;shared567192KiB lifetime RSS;35280 prompt/7498 completion tokens; current472221945 response-body bytes, five-acquisition cumulative2167006362 | Unmodified report, preparation history | 2026-10-02 21:15 UTC (does not expire) | python3 tools/check_lab.py; sum quality processCpuNs, read terminal totals, nativeTokens, preparationHistory |
CPU includes initialization/whole-process deltas; RSS shared lifetime max, not per-model/task allocation; five separate preparation envelopes and failed preparation included |
| P-34 | Fifteenth author-operated record preserves all14 earlier objects/artifact bytes; compact original2745888B SHA d8ff26e8 retains871 members, mapping to complete466005528B SHA a8036f8c901-member original with30 explicit omissions; source/protocol/compiler/48 grammars selected independently | Provenance, register, raw retentionf41a392 | 2026-10-02 21:15 UTC (does not expire) | python3 tools/check_lab.py; python -m pytest -q tests/test_boundary_retention.py; compare baseline422a724 record/artifact bytes and every selected source/full mapping |
Original outputs/comparison emitted together; full weights/source/wheels/preparation retained separately in existing private complete-original receipt, hashes cannot reconstruct omitted bytes; no outside custody/adoption |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-35 | Atomic author-operated native local-delegation run passes four declared cases across twelve distinct reader processes; exact retry/narrow scope, local revocation/renewal, expiry/tamper/ambiguous JSON and externally keyed issuer/other-subject boundaries retained separately | Original report, complete member provenance, immutable Atomic fork80be8dae | 2026-10-02 22:25 UTC (does not expire) | python3 tools/check_lab.py; inspect declared_cases, four results and twelve unique observation pid values; python -m pytest -q tests/test_atomic_retention.py |
Local API/store lookup in normal fresh OS processes, not crash-mid-write, remote revocation, server permission enforcement, model quality or external effects; PIDs unsigned runner testimony |
| P-36 | Complete author-assembled native capsule retains nineteen unmodified run files including original report, exact executable, source, lockfile, fixed population and original stdout/stderr; source80be8dae clean; capsule2126900 bytes SHA ba31071e1f0a60644117e3f4c300b16b07bc75c58caf3a5259047054132c3719 | Original native capsule, inventory and pins, rerun contract | 2026-10-02 22:25 UTC (does not expire) | python3 tools/check_lab.py; compare every ZIP member length/SHA to provenance and native report manifest; exact capsule/report reselection hostile tests |
Same-operator original local files packaged afterward, not a provider CI ZIP; private ephemeral signing keys are not retained and hashes establish byte identity, not independent operation |
| P-37 | Sixteenth bounded Lab record preserves all fifteen baseline objects and artifact bytes; upstream acceptance, completed host CI, recurring outside use and independent key/clock/store/effect custody remain unestablished for this contribution | Register, roles and publication axes, immutable Atlas baseline34a9f73 | 2026-10-02 22:25 UTC (does not expire) | python3 tools/check_lab.py; python -m pytest -q tests/test_atomic_retention.py; compare all baseline objects and source artifact bytes with git show34a9f73 |
Authored expectations exposed, native output/assertions emitted together; upstream PR publication and own tests do not establish a maintainer-owned merge or recurring host adoption |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-38 | Lab page revision0.1.2 dated2026-10-02 remains draft; native Atomic addition changes retained capability evidence without changing protocol0.1 or pending outside acceptance | Version source, Lab page, register | 2026-10-02 22:28 UTC (does not expire) | python3 tools/build.py --check; inspect Lab artifact in data/versions.toml and unchanged registry protocolVersion |
Page revision records an author-owned documentation change, not protocol release, upstream acceptance or an outside maintained workflow |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-39 | Actual installed0.0.3→0.0.4 reader preserves48/96/192-call reports, refuses384 profile before old-reader launch, verifies384 evidence without new inference, and publishes scoped report | Installed report, source contract, original main CI37068022147 | 2026-10-02 22:10 UTC (does not expire) | python3 tools/check_lab.py; compare original capsule upgrade result and reader stdout to full provider artifact11252549725 |
Author-operated normal installation/publication gate; no registry release, action/recovery authority, outside adoption or independent custody |
| P-40 | Example selected quality minimum8 correct cases/4fully-correct pairs and16format/schema-valid cases holds8 constrained policy/grounded rows through16 separate correctness/pair failures despite192schema-valid outputs; typed36013cases/5pairs pass example threshold but fail original all16/all8 claim | Original upgrade/native report values, quality policy and streams in capsule | 2026-10-02 22:10 UTC (does not expire) | python3 tools/check_lab.py; rederive each policy row’s four separate thresholds from all24 native quality rows |
Host-selected example thresholds disclosed separately; original scores unchanged; complete evidence and schema validity cannot promote held quality or model decisions |
| P-41 | Installed selected capsule283043B SHAe1b29236 retains101 byte-exact members from complete30137726B provider original SHA997e4bd6; full4964member inventory and4863 explicit omissions preserved; actual .4wheel47896B SHA031cb5fe and9external build pins authenticated | Provenance, capsule, source contract | 2026-10-02 22:10 UTC (does not expire) | python3 tools/check_lab.py; hash complete original ZIP/all4964members, compare every selected member, inspect wheel/build/source contract |
Complete original separately retained under same operator; omitted packets/earlier workflow bytes are not reconstructed by hashes; native871-member packet mapping checked separately; no independent custody |
| P-42 | Seventeenth record preserves all16 earlier literal objects and artifact bytes; selected installed gate retains24 native rows and16 quality-policy failures and refuses reselected source/report/custody/omission/acceptance substitutions | Register, selected report, source validator | 2026-10-02 22:10 UTC (does not expire) | python3 tools/check_lab.py; python -m pytest -q tests/test_installed_boundary.py; compare baseline1bdfce81 literals/artifact bytes |
Finite original-bound retained gate only; measurement, selected quality acceptance, model actions, adoption and custody stay distinct |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-43 | Native vocabulary run on 2026-10-03 preserves sixteen policy cases in two modes/32 identities/128 unique calls; frozen protocol e5bc19b, reader ff55604, reviewed head2ccc074, protected merge62f5d0c and authenticated run37094901561 stay distinct; eight-cell case rotations occupy each position twice; complete128 started/scored with zero error/incomplete/unknown-start/unsupported | Original native report, source/protocol/run provenance, exact protocol/start/return bytes in original ZIP | 2026-10-03 04:05 UTC (does not expire) | python3 tools/check_lab.py; inspect frozen protocol cases/order and all original attempt identities; compare preregistration/source/merge pins |
Exposed authored population informed by earlier384-call diagnosis; identical prompts and same seven labels per vocabulary case; no case answer oracle or representative benchmark claim |
| P-44 | Original control4/64correct and0/32complete pairs versus vocabulary18/64correct and2/32pairs; at both caps24/96,135 model control0/16,vocabulary2/16 with0/8pairs;360 control2/16,vocabulary7/16 with0/8vs1/8pairs; all128outputs schema-valid and eight rows retain all sixteen cases/eight pairs | Original scores and installed reconstruction, all-row finding | 2026-10-03 04:05 UTC (does not expire) | python3 tools/check_lab.py; sum each mode’s original quality rows and compare each original response with its frozen target |
Same-run descriptive cap comparison; recurring outputs/correct identities are not independent trials; no score retuning or policy approval from schema validity |
| P-45 | Installed default host minimum16correct/8complete pairs per row holds all eight quality rows with exit1 while accepting scoped evidence; repeat stdout byte-exact; evidence-only exit0 retains hold; changed terminal/original pins, reselected over-budget terminal and changed/reselected helper all hold evidence; zero review inference calls and no llama runtime | Actual installed receipt, original installed streams, external source contract | 2026-10-03 04:05 UTC (does not expire) | python3 tools/check_lab.py; inspect actual/repeated/evidence-only stdout and mutation decisions; python3 tools/replay_vocabulary.py --output /tmp/new-vocabulary-replay |
Host-authored strict quality thresholds; exit success in evidence-only mode grants no semantic acceptance; installed source-bound replay remains same-operator, without outside adoption/custody/effects |
| P-46 | Native45.317547439s wall/84.910453532s CPU,shared557932KiB RSS,10624prompt/1172completion tokens; prep472221945 response-body bytes in8.880832051s (rounded to nine decimal places), comprising376044704models/50688636source/45457867dependencies/30738metadata; prior five2167006362bytes and cumulative six2639228307bytes | Original native resource scopes, installed preparation reconstruction, frozen protocol/history in original ZIP | 2026-10-03 04:05 UTC (does not expire) | python3 tools/check_lab.py; read terminal totals, nativeTokens, preparation categories and resourceHistory; sum categories/current/prior history |
Whole-process CPU and shared lifetime RSS, not task allocation; separate preparation envelopes including an earlier failed preparation; no independent transfer or inference witness |
| P-47 | Frozen limits remain512MiB/180s preparation,335s build,600s wall/CPU,1GiB lifetime RSS,65536prompt/7680completion tokens,30s network operation,zero paid provider calls/dollars; complete retained run fits declared limits | Frozen protocol and resource closure, exact original report | 2026-10-03 04:05 UTC (does not expire) | python3 tools/check_lab.py; inspect protocol.budgets and report.evidence/preparation/nativeTokens/terminal |
Limits apply to this authored execution; budget compliance does not establish semantic decision correctness or protected action authority |
| P-48 | Exact native provider ZIP2248748B SHAeef05226 retains346members; complete preparation original465478943B SHA7ed25dea contains376members, mapping346native members plus30explicit omissions; all three originals’ complete inventories retain provider digest/member-byte readback and expiry | Native original, provider inventory, full-member mappings | 2026-10-03 04:05 UTC (does not expire) | python3 tools/check_lab.py; hash every retained ZIP member and compare run/ mapping, all full-preparation member identities and declared omissions |
Full weights/dependencies/source archive separately retained by same operator; public hashes cannot reconstruct omitted bytes; provider expiry or separate retention does not establish independent custody |
| P-49 | Author-assembled installed capsule120616B SHA93a86439 has37members including16byte-exact provider members and separate actual replay receipts; original9441817B SHA7d2e0c8b contains2088members with2072explicit omissions; actual wheel35389B SHA dd583f46 has nine external source pins; recorded box/CI toolchains produce different complete wheel hashes | Installed capsule, all-member provenance, source contract | 2026-10-03 04:05 UTC (does not expire) | python3 tools/check_lab.py; compare every selected member/source with primary provider inventory, wheel/build record and independent source contract |
Selection omits CI virtual environment and authored synthetic packet; package source equality is distinct from full-byte cross-toolchain wheel reproducibility; no registry release or new model inference |
| P-50 | Eighteenth bounded Lab record preserves seventeen previous literal objects/all artifact bytes; Lab revision0.1.3 and vocabulary finding0.1 dated2026-10-03 remain draft, unchanged register protocol0.1; new offline source-bound consumer repeats actual quality hold and refuses altered terminal, declared in ordinary PR workflow | Register, version ledger, source gate, offline consumer | 2026-10-03 04:05 UTC (does not expire) | python3 tools/check_lab.py; python -m pytest -q tests/test_vocabulary_retention.py; python3 tools/replay_vocabulary.py --output /tmp/new-vocabulary-replay; python3 tools/build.py --check; compare git show806abee baseline objects/artifacts |
Historical unexecuted diagnosis and new frozen result remain distinct; pending outside producer acceptance, recurring host adoption, model-action authority and independent custody remain unestablished |
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-51 | Tool-argument original run37116827382 at execution main51e0c125 retains128 started/scored calls,16 original cases/eight one-field pairs cloned into two modes/32 identities; protocol db429775 SHAf62ded1a and reviewed source884814fe precede execution; balanced order rotates eight cells; zero retries/effects/provider use | Original native report, source/member provenance, source contract, original CI run | 2026-10-03 11:13:03 UTC (does not expire) | python3 tools/check_lab.py; compare original protocol/order/declaration/start/return identities and source contract |
Exposed authored inputs/answers/thresholds informed by earlier384/128 studies; generic catalog contains no case answer; not blind or a representative benchmark |
| P-52 | All64 short24 returns reach length and fail JSON/schema; all64 long96 returns satisfy selected schema; each long135 mode strict0/16 and each long360 mode7/16; eight rows preserve16 cases/eight pairs/eight abstentions with zero correct abstentions or full pairs; all strict quality rows hold | All original rows and raw responses, native report, finding | 2026-10-03 11:13:03 UTC (does not expire) | python3 tools/check_lab.py; rederive raw JSON/schema/typed exact scores and compare all eight row denominators |
Length-finished returns retain parsed format/schema but strict correctness false prospectively; same-run descriptive comparison, no post-output cap retuning or authority from grammar success |
| P-53 | External whole-child wall228.445554164s, CPU430.234663s and lifetime RSS577276KiB include initialization/source checks/native calls/source retention/child-terminal serialization; returned tokens29992prompt/3468completion; post-child consumer separately recorded | Original external terminal and child terminal, native resource scope, original protocol resourceBoundary | 2026-10-03 11:13:03 UTC (does not expire) | python3 tools/check_lab.py; compare external/child totals and sum every original returned usage |
Same-operator Linux wait4 observation; peak RSS shared across both selected models, not per-task allocation; reconstruction runs afterward |
| P-54 | New prep charges exactly465478943 response bytes for one retained archive transfer, extracts66 selected files477404572B in13.785495131s; offline install6.719390232s/1088340047retainedB with zero dependency transfer or native build; original six-prep2639228307B remains separately historical | Unchanged archive/preparation/installation receipts, provenance, native preparationReuse | 2026-10-03 11:13:03 UTC (does not expire) | python3 tools/check_lab.py; read selected original archive-accounting/preparation-terminal/installation receipts and historical originalPreparation |
New archive charge is separate from reused model/source/wheel bytes and previous preparation; declared budgets apply to this execution; no independent transfer witness |
| P-55 | Exact native provider ZIP2639358B SHA67ef1e63 retains all331 members without omission; full preparation provider original1051848146B SHA9ae6d49f is not retained in Atlas; artifacts expire2027-01-01T10:33:56Z and Git separately retains native original | Exact native original, durable Observer original, complete native member inventory and primary provider metadata | 2026-10-03 11:13:03 UTC (does not expire) | python3 tools/check_lab.py; hash exact ZIP/every native member and inspect run artifacts API metadata |
Full preparation weights/wheels/archive/environment are omitted from Atlas; provider hashes cannot reconstruct them; author-held durable native bytes are not independent custody |
| P-56 | Nineteenth bounded Lab record preserves all eighteen earlier literal objects/artifact bytes; Lab0.1.4/new finding0.1 dated2026-10-03 remain draft, register protocol0.1 unchanged; source-bound offline checker refuses reselected evidence/quality/ownership substitutions without inference | Register, version ledger, source checker, retention contract | 2026-10-03 11:13:03 UTC (does not expire) | python3 tools/check_lab.py; python3 -m pytest -q tests/test_tool_argument_retention.py; python3 tools/build.py --check; compare baseline91632533 record prefix/artifacts |
Integrity and same-operator evidence publication only; outside acceptance, recurring adoption, protected model actions and independent effect custody remain unestablished |
Task-grouped rate example
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-57 | Synthetic task-grouped example: four matched tasks, nineteen attempts/eighteen resolved in each arm; attack/benign pooled rates12/18 and4/18 contrast4/9, equal-task rates41/80 and19/80 contrast11/40; unresolved counts and all-attempt bounds retained | Exact authored input, calculation contract, source-bound report, worked example | 2026-10-03 (does not expire) | python3 tools/check_grouped_rates.py --expect examples/task-grouped-rates/report.json; reconstruct counts from every original episode label |
Invented exposed labels; no empirical robot/model measurement, new register record, producer acceptance or independent custody |
| P-58 | Paired-task bootstrap retains both arms/all repeats in all256ordered draws; nominal0.95 nearest-rank quantile endpoints use ranks7,250: pooled contrast[-1/10,10/17], equal-task[-1/4,23/40]; missing draws block intervals, degenerate distributions disclosed | Complete rational draw distribution, checked primary source versions/hashes, reader source | 2026-10-03 (does not expire) | python3 tools/check_grouped_rates.py --expect examples/task-grouped-rates/report.json; python3 -m pytest -q tests/test_grouped_rates.py |
Exact empirical distribution, not exact population confidence coverage; independent exchangeable task assumption and unresolved-label selection remain explicit; cloning repeats adds no independent tasks |
Published robot control companion
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-59 | Provael publication f1dbc535 supplies 57 complete bound source files / 44,158,399 bytes; suite retains 400 records / 350 applicable / 50 N/A across ten tasks, five seeds, eight arms; separate controls retain 180 applicable records across ten tasks, three seeds, six arms; Python3.11+ reader, publisher-report-derived evidence class | Source file lengths and digests, fixed contract, complete outcome report, public original source | 2026-10-03 (does not expire) | python3 tools/check_provael_controls.py --source-root provael-source --expect examples/provael-task-controls/report.json; verify every bound original file and native projection digest |
Publication pin identifies source bytes, not the historical runtime; source outcomes are publisher classifications; no policy/simulator rerun or independent effect custody |
| P-60 | Suite roleplay42/50 versus none1/50; controls roleplay26/30, no-target27/30, scrambled18/30, benign-reword/nonsense0/30 and none1/30; competence controls48/50 and29/30; no unresolved native labels; 60 cross-run shared task/seed/arm keys include30 canonical-identical complete none objects | All native outcome pointers and literal manifests, source reader | 2026-10-03 (does not expire) | Reconstruct every native applicable/success/task-success flag and all seed/arm cells; compare complete canonical episode objects across the two original runs | Shared records do not establish fresh independent benign repeats; runs are not pooled; not-applicable false flags never become measured safe outcomes |
| P-61 | Joint integer task convolution yields9581 suite states and1716 controls states, each weighted to10^10 ordered whole-task draws; equal allocation5/3 per measured task makes episode and task weighting coincide; nominal95% inverse-CDF endpoint ranks250000000/9750000000; roleplay-minus-none suite41/50 endpoints[30/50,49/50], controls25/30 endpoints[19/30,30/30]; controls roleplay-minus-no-target -1/30 endpoints[-3/30,0/30], minus-scrambled8/30 endpoints[4/30,12/30] | Complete exact joint count weights, quantile and allocation contract, reader | 2026-10-03 (does not expire) | python3 -m pytest -q tests/test_provael_controls.py; independently enumerate small ordered fixtures or ten-task weak compositions with multinomial weights; sum every state weight |
Exact empirical bootstrap distribution only; ten selected benchmark tasks do not establish independent exchangeable population sampling or nominal/simultaneous confidence coverage; weights are not additional trials |
| P-62 | Publisher MC uses2000 random.Random0 task draws/floor-indexed endpoints; exact scrambled interval[12/30,23/30] differs from publisher[13/30,23/30]; control Holm family includes five non-baseline arms, suite six applicable attacks; E-2026-12 corrects targeted-control attribution without changing counts; all20 reports declare calibratedfalse; suite runtimecommitnull, controls shortde6c231, repository/lock/precision/checkpoint/config bindings remain null | Literal publisher aggregate analyses and manifests, original erratum and support-source digests, publisher method distinction | 2026-10-03 (does not expire) | Inspect exact bound publisher paired.py, aggregate.json, erratum and all manifests; rerun complete source reader; compare episode flags with native decision flags | Envelope fragility under long imperative strings, not demonstrated attacker-directed object control; safety predicate/calibration/physical harm are not independently evaluated; newer publication source cannot reconstruct missing historical runtime |
| P-63 | Separate robot companion0.1, claim ledger0.8.3 and Lab0.1.6 dated2026-10-03 remain draft; original19 register objects/artifact bytes and first rate example are unchanged; source ZIP retains complete57files, LICENSE/NOTICE/trademark attribution; paired native CI reconstructs outcomes and retains complete bound source ZIP/report | Companion, versions, workflow, register, unchanged first example | 2026-10-03 (does not expire) | python3 tools/check_lab.py; python3 tools/build.py --check; python3 -m pytest -q tests/test_provael_controls.py; read complete native artifact inventory and all source ZIP members |
Source-reader CI is analysis of publisher simulator records; no new empirical register record, model rerun, hardware execution, producer acceptance or independent custody |
| P-64 | Lab draft0.1.7 and claim ledger0.8.5 dated2026-10-04; three native qualification records bring the register to22; all19 earlier objects and retained artifact bytes remain unchanged | Register, prior source1f1a44fab47cba2d0fb032924d4af838063919b3; retained originals015db522e2af22e9c12fce7c5bac44d3d070f49a and419700b6a2c1bb60a77ef87d13d1a15ab057069a | 2026-10-04 (does not expire) | python3 tools/check_lab.py; compare first19 parsed records and their artifact digests with prior main |
Added records retain author-operated comparisons and exposed expectations; no frozen study population or historical result changes |
| P-65 | APS Node20.20.2/22.23.3 each1223 cases,1048 declared exact byte accepts,175 refusals,1069 APS strict-parser accepts; parsed serialization accepts42 raw-refusal rows and strict parsing differs on23 policy rows | Native-derived report, both original archive manifests, source lock | 2026-10-04 (does not expire) | python3 experiments/aps-jcs-2026-10-04/validate_capsule.py; authenticate both originals and count all unique native identities and policy outcomes |
The two runtimes repeat the same population. The42 include Unicode/numeric profile differences; they are not all duplicate losses |
| P-66 | Five signed APS receipt controls remain separate from serialization; both duplicate-issuer variants stop before signatures; machine and signed receipt outcomes agree across runtimes while88 SyntaxError messages differ in prose;721 licensed original source members retained separately | Native-derived receipts, runtime comparison, complete selected-source manifest | 2026-10-04 (does not expire) | Authenticate each native/source member, check signed receipt stages and exact runtime machine projections through the retained validator | Full serialized receipt verification, parsed serializer and strict parser have distinct scopes. Registry packages/runtimes are not vendored; outside APS adoption and the formal pending study remain separate |
| P-67 | ADK86a47f6974bae349a5c9ea15a74a4b450614ae42: three three-turn cases on each passing PR/main execution, response issuer/call binding and later root routing, observed writes1/0/1, callbacks38/38/33 closed without failures,19 semantic controls,778 selected native Python sources | Native-derived report, four original attempt inventories, replay | 2026-10-04 (does not expire) | python3 experiments/google-adk-responses-2026-10-04/validate_capsule.py; inspect original native wrappers, call IDs, callbacks, signed write requests, source Git blobs and controls |
Fixed public BaseLlm responses; resumability disabled; same-host LRO completion separate from native start-only body. Failure, correction, PR and main originals stay distinct; PEER author custody |
| P-68 | Actual Verifye835ce2bd6a960e7a1cc2fa6522f16d55dce728a uses11 unchanged selected Python files; six event_absence/v1 cases repeat byte-exact twice per qualified ADK run, three boundary controls retain contradicted/not_established/exit2-no-verdict; routing reader also repeats exactly | Separate Verify receipts and decisions, original member provenance, installed-reader replay | 2026-10-04 (does not expire) | Retained validator checks all twelve original Verify outputs per passing execution, their process statuses and distinct boundary-control outputs; replay the installed wheels | Verify covers the six finite plugin-delivered turns. Whole-second projection retains original fractional timestamps. Older16rows remain separate and prospective eight-task execution remains not-started |
| P-69 | Go1.25.5/1.27.1 each1263 identities,1077 exact consumer byte matches,181 raw refusals and five scalar-root refusals; each retains1263 bare Go observations including1129 accepts; six separate PR/push/main originals retain714 members | Native-derived report, complete member inventories, source pins | 2026-10-04 (does not expire) | python3 experiments/go-jcs-2026-10-04/validate_capsule.py; compare all six exact report copies, source/license/corpus pins, raw controls and runtime outcomes |
Repeated conformance identities remain six separate executions. RFC8785/I-JSON and Go object/array domains remain distinct. Installed executable hashes are retained; full runtimes/executables are outside originals |
| P-70 | JEP48 merged10fe4de7d26bcd35db39762d84c6211ab9ccfa11 on2026-10-04; maintainer confirms25 validation+4 producer+8 acceptance assertions in host PR attempt2 and main CI; recurring required candidate check awaits regression/suite-update review | Maintainer fixed-version completion, conditional candidate-check support, merged PR | 2026-10-04 (7-day cadence) | Read exact merged PR and both maintainer comments; inspect host run37041094828 attempt2 and37165726336 at suitea87a395b54b5685fd22d6cc86d120058f1c8850d/readercbd3ea8f4de89b835d6d3c4182ff4b4b1c7608f9 | Fixed-version host reproduction is established; recurring required candidate integration remains pending. Original Probity-run Lab objects are preserved |
| P-71 | Lab0.1.8 and claim ledger0.8.7 dated2026-10-04 add the23rd record while preserving22 earlier objects/artifact bytes; each of two qualified AG2 PR/main runs has18 native tasks,12 stored configurations,6 target callbacks and3 observed writes over six variants and three transports | Native-derived report, complete original inventories, register, retained-source91824c04833725b208842a8fcc523c7e91a3f8e4; prior maincc6609e15978814b37bebb9119999a5373dfc9e5 | 2026-10-04 (does not expire) | python3 experiments/ag2-push-authority-2026-10-04/validate_capsule.py; python3 tools/check_lab.py; compare first22 record objects and their artifact digests with prior main |
Both executions repeat the same finite task population with fixed exposed answers; source publication precedes indexing; native comparisons were emitted together |
| P-72 | Per transport, stored/callback/write counts are accepted1/1/1, registration-denied0/0/0, sender-denied1/0/0, target-denied1/1/0, legacy1/0/0 and SDK-policy-denied0/0/0; each qualified run retains16 semantic controls, two byte-identical installed-reader decisions,453 AG2 and127 A2A Python source files;15 omitted empty refused-case directories must be restored for installed replay | Native fields and decision repeats, source/license/member inventories and distinct failures, installed replay | 2026-10-04 (does not expire) | Retained validator authenticates every archive member and reconstructs all18 task/configuration/callback/effect rows from original native JSON, verifies source Git blobs and checks original control/repeat streams | Explicit host sender call after task completion; controlled ASGI target and plaintext loopback gRPC; captured JSON semantics, no wire decoding. PEER author operator; no provider inference, automatic task callbacks or outside adoption. Older16rows unchanged; prospective eight-task study not-started; setup failure executed no native cases |
| P-73 | Atlas publication 77968b3f added the 24th Lab record and records Lab 0.1.9 dated 2026-10-04 and claim ledger 0.8.11 dated 2026-10-05. It preserves 23 earlier objects and artifact bytes; the current REMORA README digest binds the later scope correction. REMORA fe324dd7 boundary packages read by reader 308c5b44: exact-call-binding 15/15, fresh-authority 14/14 and effect-evidence 12/12 cases equal fixture expectations on CPython 3.13.15 and 3.14.7 |
Original publication versions; native-derived report; three run records, originals and scope correction; provenance; original run | 2026-10-05 (does not expire) | Read the immutable publication versions; python3 experiments/remora-boundary-2026-10-04/validate_capsule.py; python3 tools/check_lab.py; compare the first 23 record objects and their artifact digests with prior main |
Exposed fixture expectations; native outputs and comparisons emitted together; test-only HMAC key; effect hash rule unsupported; no production safety, authority or lifecycle change |
| P-74 | Each of the three external-run-record-v1 files states SECOND_IMPLEMENTATION, operator EXTERNAL, maintained_by EXTERNAL and independence NOT_INDEPENDENT; package digests48dd143c,234c57d0,26c437c6 recompute from retained manifests and input hashes; same run caught all9 source mutations | Run records, native-derived report | 2026-10-04 (does not expire) | Retained validator authenticates every member of both archives, recomputes package digests and compares each extracted record to the original native output | Under REMORA’s lifecycle rule these records support REPRODUCED, not EXTERNALLY_VERIFIED; producer review of these run records has not started; Probity authored and operated the reader |
| P-75 | The 25th Lab record retains public AEOESS154: two byte-identical reports and stdout streams over the same25 receipt fixtures;50 profile answers per run;21 GNU SHA-256 context-free identifier matches; four context-bearing identifiers remain uncovered | Original run declaration, derived report, source bindings | 2026-10-05 (does not expire) | python3 experiments/aeoess-receipt-signature-2026-10-05/validate_capsule.py; compare all51 retained members with pinned Git blobs; confirm all24 earlier register objects and artifact bytes unchanged |
Claude under Tymofii Pidlisnyi (@aeoess)’s revocable mandate is the original source declaration; actor, model, human review and container custody are not independently authenticated. Public answers exposed; author harness grades outcomes. No four-ID outside recomputation, full-family admission or independent effect custody |
| P-76 | Always-valid negative control yields8failures and3SHOULD refusals; one signature mutation affects5shared-receipt members, each signature_invalid under both profiles; explicitly selected unmodified corpus remains25PASS; original16file digest bindings retained | Original controls and complete capture, report, provenance | 2026-10-05 (does not expire) | Authenticate source capsule and original SHA256SUMS; reconstruct complete report/stdout populations and positive/negative controls with the data-only checker | Retention validation executes no captured scripts or outside verifier. Fixture control interpretation remains author implementation; maintained host jobs, production workloads and independently operated custody are not established |
Links
| id | claim | how it was checked | read (UTC) | limit |
|---|---|---|---|---|
| L-01 | Every internal link and anchor on the site resolves, and every link to the site’s own published address names a page that was built | python3 tools/check_links.py |
2026-09-27 09:40 (7-day cadence) | Checks the built docs/ directory |
| L-02 | Every external link answers 2xx, except links on hosts that refuse automated reads, each of which has its own row in this section | python3 tools/check_links.py --external; crates.io, doi.org and GitHub file links are checked through the same resource’s API |
2026-09-27 09:40 (7-day cadence) | A 2xx answer shows a page exists, not that it still says what the claim quotes |
Project catalog
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| C-01 | Probity Vocabulary: released | Pinned README; data/catalog.json |
2026-10-04 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned README Status section |
Published registry, not an evaluation of a deployed agent. |
| C-02 | Probity Vectors: released | Pinned README; data/catalog.json |
2026-10-04 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned README Status section |
A released conformance suite; each corpus defines the claims it tests. |
| C-03 | Probity Observer: prototype | Pinned README; data/catalog.json |
2026-10-04 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned README Status section |
Prototype label follows the pinned README; the local broker and selected readers have separate scopes. |
| C-04 | Probity Verify: unreleased | Pinned README; data/catalog.json |
2026-10-04 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned README Status section |
Source is public; the pinned README states there is no package release. |
| C-05 | Probity Admission: draft | Pinned README; Budget API and CLI; data/catalog.json |
2026-10-04 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned README Status section |
Draft is the catalog label for policies following the proposed predicate. |
| C-06 | jcs-admit: released | Pinned README; data/catalog.json |
2026-10-04 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned README Status section |
Released library; raw-input admission is separate from envelope verification. |
| C-07 | dsse: released | Pinned README; data/catalog.json |
2026-10-04 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned README Status section |
Released envelope library; signature verification does not check the truth of a payload. |
| C-08 | Probity Atlas: draft | Pinned README; data/catalog.json |
2026-10-04 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned README Status section |
Draft documentation and run register; run evidence keeps its recorded review state. |
| C-09 | Home 1.7, project catalog, automation and maintenance guides 0.1, and claim ledger 0.8.4 are draft artifacts dated 2026-10-03 | data/versions.toml; version ledger |
2026-10-03 (does not expire) | python3 tools/build.py --check; read data/versions.toml |
Documentation revisions; retained Lab objects and evidence bytes are unchanged. |
| C-10 | Project catalog and maintenance guide 0.2, and claim ledger 0.8.6 are draft artifacts dated 2026-10-04 | data/versions.toml; data/catalog.json; data/catalog-sources.json; version ledger |
2026-10-04 (does not expire) | python3 tools/build.py --check; validate the catalog against its previous baseline and compare the generated public projection |
Documentation revisions and refreshed README source pins; Lab records retain their separate revisions and executed scopes. |
| C-11 | Project catalog and maintenance guide 0.3, and claim ledger 0.8.8 are draft artifacts dated 2026-10-04; current project quickstarts and summaries use reviewed public sources | data/versions.toml; data/catalog.json; data/catalog-sources.json; tools/build.py; version ledger |
2026-10-04 (does not expire) | python3 tools/build.py --check; python3 tools/check_links.py; compare docs/catalog.json with the reviewed public projection |
Current project navigation; retained Lab records, original source rows and experiment bytes keep their recorded claims and scopes. |
| C-12 | Claim ledger 0.8.9 is a draft artifact dated 2026-10-04; built pages have readable Markdown mirrors with checked links and stable fragments | data/versions.toml; tools/markdown_mirrors.py; tools/build.py; tools/check_links.py; version ledger |
2026-10-04 (does not expire) | python3 tools/build.py --check; python3 tools/check_links.py; python3 -m pytest -q tests/test_markdown_mirrors.py |
Documentation retrieval from the same expanded public sources; original Lab claims and experiment bytes retain their scopes. |
| C-13 | Probity native Inspect reader: prototype; reads selected retained execution profiles offline and preserves errors and unstarted attempts | Pinned consumer guide; Observer status source; data/catalog.json |
2026-10-05 (does not expire) | python3 tools/discoverability/catalog.py validate data/catalog.json; read the pinned guide’s supported profile and selected-input rules |
Offline selected-byte consistency, not execution of Inspect, arbitrary-log support, independent capture or custody. The prototype label follows the owning Observer status source. |
| C-14 | Inspect accepted the reader catalog entry on 2026-10-03; its live listing was awaiting publication at 2026-10-05 01:04 UTC | Merged PR; accepted entry; published branch catalog; live catalog | 2026-10-05 01:04 (7-day cadence) | Read PR merged_at and the accepted entry; compare the live catalog bytes with the pinned published catalog; inspect data/catalog-sources.json |
The live response equals the older pre-merge published catalog. Repository documentation acceptance establishes no maintained Probity dependency, required native host gate, independent operator or outside workload. |
| C-15 | The earlier Atlas publication a8c358bd records draft Home 1.8, project catalog and maintenance guide 0.4, and claim ledger 0.8.10, dated 2026-10-05 |
Earlier version source; earlier version ledger | 2026-10-05 (does not expire) | Read the immutable version source and compare its Home, project catalog, maintenance guide and claim ledger rows | Earlier publication metadata; current navigation has its own versions. Historical Lab records, experiment objects and their executed source pins retain their recorded scopes. |
| C-16 | Current JCS and DSSE quickstarts select the exact crates.io 0.1.1 dependency and installed-version API reference | JCS source; DSSE source; data/catalog-sources.json |
2026-10-05 (does not expire) | Read both pinned READMEs; inspect their cargo add version requirements and docs.rs URLs; build the catalog |
Current installation navigation; published crate contents and historical Lab records retain their original pins. |
| C-17 | Witnessed run selection is a prototype profile that checks a supplied run against consumer-retained witness anchors, plan and control pins, and execution closure | Pinned installed profile guide; Observer status; data/catalog.json |
2026-10-05 (does not expire) | Read the pinned guide and its installed consumer commands, positive result and hostile controls; validate the public profile | Consistency of one supplied anchored history; global selection, real-time precedence, execution truth and independent custody remain unestablished. No outside operation or new study result. |
| C-18 | Project catalog 0.5 and claim ledger 0.8.13 are draft artifacts dated 2026-10-05 | data/versions.toml; data/catalog.json; data/catalog-sources.json; version ledger |
2026-10-05 (does not expire) | Build and check the catalog and generated public projection | Current task navigation and documentation revisions; existing Inspect guide and historical Lab records retain their recorded pins and scopes. |
| C-19 | Current Observer quickstart pins an unreleased source installation at f68c8538639aea1515ea357a85a20739004e66fd; its current README links installation and profile selection and witnessed run selection |
Current README; data/catalog-sources.json |
2026-10-05 (does not expire) | Read the pinned README and its git checkout command, unreleased status and consumer guide links; build the catalog |
Current installation navigation; source installation is not a registry release. The PEER witness and selected-history limits, historical Inspect guide, Lab records and executed source pins retain their recorded scopes. |
| C-20 | The Vectors quickstart at the recorded October 5 04:56 UTC read selected Go source tag v0.17.0 and Python harness source 906dca103e2fe2e1e719dc58f8337b1b90b6562d. At 2026-10-05 04:56 UTC, PyPI 0.17.0 was unavailable, while the same read path returned the published 0.16.0 package |
Current README; installation routes; expected-404 endpoint https://pypi.org/pypi/agent-evidence-vectors/0.17.0/json; positive control; data/catalog-sources.json |
2026-10-05 04:56 (7-day cadence) | Read the immutable quickstart and source-commit commands; compare the two version-specific PyPI API responses and the installation route status | Go source and a source-built Python harness; no PyPI 0.17.0 release claim. Installed populations belong to their selected source or package version. Historical REMORA reader and original signed release objects retain their recorded pins and scopes. |
| C-21 | Current Vectors navigation selects the reviewed source at 10e6745b24db77a7bdd4dcc0cdd84f4b46063b7c. GitHub and PyPI publish matching 0.17.4 artifacts; the release route installs the Go verifier and Python harness at that version. |
Reviewed README; installation guide; GitHub release; version-specific PyPI metadata; data/catalog-sources.json |
2026-10-05 (does not expire) | Read version-specific release metadata and artifact hashes; run go install github.com/probityai/agent-evidence-vectors/cmd/aee-verify@v0.17.4 and uvx agent-evidence-vectors==0.17.4 --verifier "aee-verify --json" with Go 1.24+, Python 3.13+ and uv |
Current installation navigation and a declared release. The default command selects one corpus, not all corpora. No new outside operator, custody, maintenance, Bitcoin finality or study result; historical release and source records retain their original bytes. |
Worked evidence replay
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| W-01 | The retained replay exits zero and prints admitted plus the exact replay, authority and signature refusals; every refusal preserves consumer state. The article selects Atlas 57d0085723c9eee1400797acf6729c4204325451, Observer 8562c25fb7ec97596ea9d0297c495340298914b6, Python 3.12.14 and cryptography 46.0.7. | Historical runner; recorded result; worked article; E-10 through E-13 | 2026-10-05 (does not expire) | Run the article commands; require the complete report with --expect and retained files with --manifest; compare selected stdout with the article |
A source-pinned retained fixture replay, not a current package-install recommendation, new Lab record, live-agent run, independent operator or independent custody. |
| W-02 | The home page groups all eight public components by task and links the retained replay walkthrough; the machine guide also links that walkthrough. | data/catalog.json; assets/component-tasks.svg; src/index.md; tools/discovery.py |
2026-10-05 (7-day cadence) | python3 tools/build.py --check; python3 tools/check_links.py; compare the map with the reviewed catalog and read llms.txt |
Entry points, not inferred architecture or dependencies. Navigation coverage is not a real discovery attempt or a human walkthrough. |
| W-03 | The retained replay article has a source-owned 1200 by 630 PNG preview exported with CairoSVG 2.9.0, an editable SVG and explicit alt text. Optional preview metadata and existing description attributes use escaped plain text with a 512-character limit; paired fields bind the image to a regular PNG declared for that built page. | assets/admission-social.svg; assets/admission-social.png; assets/README.md; tools/social_metadata.py; tests/test_social_metadata.py |
2026-10-05 (7-day cadence) | python3 tools/build.py --check; python3 -m pytest -q tests/test_social_metadata.py; inspect the generated article’s OG URL against its canonical link and both preview URLs against the served source bytes |
Published metadata support and author-owned visual sources; no social platform retrieval, search ranking, discovery outcome or outside operator claim. PNG export depends on the renderer and system fonts. |
| W-04 | The task-grouped rates guide cites Cameron and Miller through the publisher’s DOI. Its source record still identifies the originally checked July 2014 manuscript and hashes; the statistical fixtures and methods are unchanged. | Published article; examples/task-grouped-rates/README.md; examples/task-grouped-rates/source-record.json |
2026-10-05 (7-day cadence) | Read the DOI with normal TLS verification and compare the publisher title, authors and DOI with the original source record; run the grouped reader against its unchanged expected report | Citation-route maintenance after a certificate failure, not a new statistical source review, measured result or coverage claim. |
| W-05 | Human and agent project navigation prints the existing catalog IDs beside display labels. Profile entries retain their owning component ID. | data/catalog.json; tools/discovery.py; tools/discoverability/catalog.py; tests/test_discovery.py |
2026-10-05 (7-day cadence) | Build the site and compare the printed identifiers with the reviewed public catalog; run the navigation checks | Existing identifiers and source pins remain unchanged. Visible identifiers do not establish successful discovery, executed recipes or corrected past client findings. |
Retained run navigation
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| W-06 | The retained-run browser projects every registered record’s existing per-claim result, declared roles, limits, report, provenance and contract. Search and exact result-token filters enhance a complete static HTML and Markdown view. The home page, Lab, navigation and machine guide link the browser. The version ledger records this presentation revision. | data/lab-register.json; tools/run_browser.py; src/runs.md; assets/run-browser.js; assets/run-browser.css; tests/test_run_browser.py; tests/test_run_browser_layout.py; data/versions.toml |
2026-10-06 (does not expire) | python3 tools/run_browser.py; python3 tools/build.py --check; python3 tools/check_lab.py; python3 tools/check_links.py; run the source and actual-browser controls, including keyboard, mobile and no-JavaScript checks |
Presentation of retained source facts, not authenticated operator identity, aggregate run grades, new measured records, host adoption, independent operation or a real discovery evaluation. Procedures link only when the register supplies one. |
APS and PriorSeal replay interface
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-77 | Current APS/PriorSeal generators use v2 records, require one caller-declared runner identity of 1 to 512 UTF-8 bytes, and bind the entrypoint/helper files read at invocation by SHA-256. The wrapper predicate is meetsRunContract. Copied tools need the helper and the replay’s unchanged baseline data. | experiments/aps-priorseal-source-replay/runner.mjs, run.mjs, check-run-contract.mjs, test-runner.mjs, RUN.md; .github/workflows/aps-priorseal-replay.yml |
2026-10-06 (does not expire) | Run both public entrypoints and test-runner.mjs against the declared pinned producer checkouts; compare caller declarations, source hashes, actual CLI refusals and historical outcomes |
Declared identity and local source-byte bindings, not authenticated operator identity, publisher attestation, Probity admission, outside custody, producer acceptance or new study scores. Historical records keep their original schemas and bytes. |
Current catalog and replay routes
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-78 | The catalog keeps its eight component identities and earlier profiles, refreshes source-backed repository pins, and adds published APS refund-retry and MintID trace-reader profiles. The replay tools page links one complete procedure from the automation guide, pilot status and machine guide. | data/catalog.json; data/catalog-sources.json; src/replay-tools.md; src/automation.md; src/pilot.md; tools/discovery.py; data/versions.toml |
2026-10-06 (does not expire) | Validate the catalog and source bindings; build the site; check links; render the replay route with desktop/mobile, keyboard and no-JavaScript controls | Published source routes and local generated-page controls, not new component or package releases, producer acceptance, customer use, independent operation or measured discovery success. Earlier source records and version rows remain retained. |
Discovery task evaluation
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| D-01 | Fixed discovery suite: 25 tasks in two modes; target 90 percent accepted agent first attempts per complete mode; five declared-unfamiliar human walkthroughs with a two-choice target; the empty example retains all 50 cells as not executed. The local packet workflow uses Python 3.11 or later and refuses invalid inputs with exit 2. | Pinned definitions and source hashes; packet reader; empty report; workflow | 2026-10-05 (does not expire) | python3 tools/discovery_evaluation.py check; report the empty example; python3 -m pytest -q tests/test_discovery_evaluation.py; inspect source references and the declared targets |
Product navigation definitions and author-operated finite packet controls. No real search, agent client or unfamiliar reader executed; targets are goals, not observed results. Role, time, source-access and review declarations are unauthenticated. Author checks, research studies, installed-command results, host adoption and independent custody remain separate. |
Historical report and diagnostic retained accounting
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-79 | The historical Vectors 0.12.0 record has 272 passing harness comparisons and report states of 31 pass, 239 fail and two inconclusive. Its six-cell crosswalk preserves record validity separately from outcome. | experiments/w3c-report-replay-2026-10-06/original-RUN.json; original-conformance-report.json; original-report.json; per-case-outcomes.json; report-replay-configuration.json; source-manifest.json in the same directory |
2026-10-06 (does not expire) | python3 tools/check_report_replay.py; python3 tools/check_lab.py --record w3c-report-replay-2026-10-06 --json |
Retained historical output accounting, not new native replay, a real workload, independent implementation or current Vectors release behavior. The two originally inconclusive dispositions stay unchanged. |
| P-80 | Separate Vectors 0.13.0 diagnostic outputs cover 232 fixtures: removing the failed-control-witness predicate changes one rejecting case; removing checker/configuration binding changes two. Each preserves all 116 accepting controls. Exactly 17 approved public source files retain their original digests, license and source notice. | experiments/w3c-report-replay-2026-10-06/logic-control-configuration.json; logic-control-evidence.json; both per-case files and mutant source copies; SOURCE-ORIGIN.json; source-manifest.json |
2026-10-06 (does not expire) | python3 tools/check_report_replay.py; inspect original pins and exact one-predicate byte changes without executing captured source |
Author-operated diagnostic outputs with exposed answers. The historical proposed binding rule is not promoted to normative text. No independent operation, customer payment, action completion or maintained outside host is established. |
Worked interpretation and public research routes
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-81 | The worked article retains the historical 272-case replay on CPython 3.13.7 and 3.14.3, its package/source/report/harness/corpus identities, 61 accepting, 209 rejecting and two indeterminate fixtures, and 30 valid negative results. The original installed 0.12.0 package’s 1,191 package members matched wheel bytes and source Git blobs. The separate 0.13.0 diagnostics and draft rule status retain their own scope. Home, Lab, automation, experiments and the generated machine guide link the article and retained record. | Historical source; historical wheel metadata; experiments/w3c-report-replay-2026-10-06/report-replay-configuration.json; historical-summary.json; logic-control-configuration.json; source-manifest.json; src/evidence-test-meaning.md; data/versions.toml |
2026-10-06 (does not expire) | Recompute retained counts with python3 tools/check_report_replay.py; inspect exact wheel and source package members, excluding distribution metadata; build and check all route links; retain actual desktop/mobile and keyboard renders |
Existing author-operated historical measurements. The maintained Atlas consumer checks retained output consistency without executing old reader code. The refund story is hypothetical; W3C correspondence stays draft. No real refund, independent implementation, customer deployment, payment, new study, host adoption or discovery success is established. Earlier records and frozen attempts remain unchanged. |
Practical Lab entry and technical disclosure
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-82 | The Lab opens with a practical evidence question, contribution offer, and links to retained runs and the refund example. Detailed protocol, source pins, replay commands, and historical run limits remain in an expandable section. Replay instructions use the owning repository environment with the same Python and cryptography pins. | src/lab.md; data/lab-register.json; experiments/observer-admission/run.py; original Lab source at c28b1ab7c19c6644970df71a8576907b5bc0ac2b; Observer refund guide at e7ac5370053c6630de6ed2b746d7ffcefe66f075 |
2026-10-08 (does not expire) | .venv/bin/python tools/build.py --check; .venv/bin/python tools/check_links.py; .venv/bin/python tools/check_lab.py; inspect the rendered disclosure and source diff against the pinned Lab |
Documentation and a proposed participation route. Register objects and original evidence are unchanged. No new native replay, accepted coalition seat, outside operation, deployment, or commercial agreement is claimed. |
Approved SQL illustration
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-83 | The approved-SQL illustration has 16 author-created fixtures and 56 passing tests. Its reader compares approval, application and audit projections, preserves transaction outcomes, and keeps a later state difference separate from an earlier recorded commit. | examples/approved-sql/QUALIFICATION.json; fixtures/manifest.json, qualification/tests.xml, qualification/steps.json and sql_illustration/check.py in that directory |
2026-10-09 (does not expire) | In examples/approved-sql, run uv sync --frozen --group dev and .venv/bin/python scripts/qualify.py; inspect the retained test and case outputs; build and check the published page |
Author-created supplied-record comparison, not a native Tadpole export, database execution, authenticated approval, verified complete audit collection, independent operation or host adoption. Code and fixture bytes match the measured source; adapted documentation retains the limits. |
| P-84 | The source map distinguishes Tadpole application users from database principals, mutable connection references from execution-time targets, statement outcomes from commits, and turn-level audit identifiers from the illustration’s comparison identifier. It retains the source pin and producer draft API version/hash. | examples/approved-sql/SOURCE-MAP.md; linked Tadpole public source at d72351937e7c0d8a0742348a828283cf45d6e16a; linked Integration API draft 1.0.0-draft, SHA-256 8abd24714b912420e101e90d0f010570cd79296c22ab7c4fbdfde3f2d90e821e |
2026-10-09 (does not expire) | Inspect the pinned source paths and linked draft schemas; compare their field meanings with the input contract and source map | Dated source reading and a producer-published draft. No claim that the older engine is the current enterprise implementation, or that the nominated native pair has been supplied. |
| P-85 | The request/effect case table freezes a proposed experiment against the selected execution-join contract: pre-dispatch rebinding, a later changed resource and a failed digest recomputation retain separate meanings. Declared, hashed-action and executor-configured targets remain separate experiment fields. | examples/request-effect-join/CASE-TABLE.md; selected producer contract; case author’s distinction |
2026-10-09 (does not expire) | Compare the table with the selected contract’s invariant 6 and failure-code meanings; inspect proposed status and separate original result/later-observation fields | A proposed source-bound experiment, not a completed producer verifier run, new normative contract, approved post-commit code, observed executor dispatch or independent operation. |
Corrected-wrapper regression
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-86 | The corrected-wrapper regression retains 14 case outcomes and 63 passing tests; it separates actual command exits, the wrapper’s recorded status and a bounded native-field report projection. Runtime and test files match preparation 42089b9. |
examples/e030-corrected-wrapper/QUALIFICATION.json; qualification/tests.xml, qualification/demonstration.json, INTEGRATION.json and docs/SOURCE-MAP.md in that directory |
2026-10-09 (does not expire) | In the example, run uv sync --frozen --group dev --python 3.14.7 and .venv/bin/python scripts/qualify.py; inspect the retained tests and all 14 case outcomes |
Unchanged pinned wrapper with injected npm/node commands and author-created reports. No producer verifier or signature execution, authenticated operator, native invocation binding or new outside adoption. The historical vector and Pico’s outside keeper stay separate. |
Signed witness-pair reader
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-87 | The signed witness-pair reader retains all 8 assertion values per record: A has 7 true and 1 null, B has 4 true and 4 null. Preparation R2 passed 62 tests; four actual CLI reads returned 0/1/1/1 for A/a2a, B/a2a, A/a2a/ and B/a2a/. Both signatures verify under separately pinned current local keys. Original API/key/OTS bytes and failed R1 remain retained. | examples/nenrin-witness-pair/qualification/RESULT.json, qualification/tests.xml, qualification/pair-*.json, INTEGRATION.json, docs/SOURCE-MAP.md and qualification/original-r1/; supplied pair |
2026-10-09 (does not expire) | In the example, run uv sync --frozen --group dev --python 3.14.7 and .venv/bin/python scripts/qualify.py; compare exact canonical record/key pins and all assertion values in the retained reads |
Probity wrote and ran this second reader from the signed format. Current local-key verification is separate from historical key control, card/response correctness, timestamp proof validation and affiliation-independent observation. This reader’s author-run is separate from the supplied witness observations; no outside use of the new reader is inferred. |
Agent incident record
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| N-01 | Twelve incidents listed; no attacker in any; the agent’s own account later shown false in 3 (rows 1, 6, 12) | The twelve public sources below, read and captured one by one | 2026-10-09 20:54 (does not expire) | Count the rows of the table on agent-incidents.html | A curated list, not a sample; “No” means no public source shows the account false |
| N-02 | Row 1: Replit agent deleted SaaStr’s production database in July 2025, said rollback was impossible, and the rollback worked | SaaStr post; The Register, 21 July 2025; AI Incident Database 1152 | 2026-10-09 20:54 (does not expire) | open the three pages | The victim’s and the press’s account; no vendor post-mortem is cited |
| N-03 | Row 2: PocketOS production volume and backups deleted through the Railway API in April 2026; the agent wrote an explanation of the rules it broke | Founder’s post on X; The Guardian, 29 April 2026 | 2026-10-09 20:54 (does not expire) | open both pages | The explanation is quoted, not verified |
| N-04 | Row 3: Kiro reported in a 13-hour AWS Cost Explorer interruption in December 2025; Amazon attributes it to user error | Amazon’s correction post; AI Incident Database 1442 | 2026-10-09 20:54 (does not expire) | open both pages | Two accounts disagree; the Financial Times article could not be read and is not cited |
| N-05 | Row 4: Claude Code recursive delete, October 2025; the log held the output but not the command | anthropics/claude-code#10077 | 2026-10-09 20:54 (does not expire) | open the issue | The reporter’s account |
| N-06 | Row 5: Cursor agent damage across two machines, December 2025; the agent wrote the bug report at the user’s request | Cursor forum posts of 8 December and 26 November 2025 | 2026-10-09 20:54 (does not expire) | open both posts | The report is the agent’s own |
| N-07 | Row 6: Gemini CLI file move, July 2025; the user reports the agent hallucinated losing the files | google-gemini/gemini-cli#4586 | 2026-10-09 20:54 (does not expire) | open the issue | The reporter’s account |
| N-08 | Row 7: Google Antigravity deleted a D: drive, November 2025; its reasoning traced the command; logs sent to Google | Reddit r/google_antigravity post of 27 November 2025 | 2026-10-09 20:54 (does not expire) | open the post in a browser | Plain HTTP clients get a login page; read through a browser |
| N-09 | Row 8: Claude Code ~ directory and rm -rf *, November 2025 |
anthropics/claude-code#12637 | 2026-10-09 20:54 (does not expire) | open the issue | The reporter’s reconstruction |
| N-10 | Row 9: Claude Code delete ending in ~/, December 2025; the agent identified the command from the log |
Reddit r/ClaudeAI post; Simon Willison, 9 December 2025 | 2026-10-09 20:54 (does not expire) | open both pages; the Reddit post in a browser | Plain HTTP clients get a login page for Reddit |
| N-11 | Row 10: a coding agent wiped a project database, July 2026, admitted it, and the pages were restored | Reddit r/Anthropic post of 29 July 2026 | 2026-10-09 20:54 (does not expire) | open the post in a browser | The user’s account; plain HTTP clients get a login page |
| N-12 | Row 11: OpenAI’s March 2026 report on monitoring its internal coding agents | OpenAI, How we monitor internal coding agents for misalignment | 2026-10-09 20:54 (does not expire) | open the page in a browser | Plain HTTP clients get a script check; a vendor’s own disclosure |
| N-13 | Row 12: a delegated subtask never started; the model reported “Implementation running”; the card calls the response “a fabrication, because no work was in progress” | Claude Opus 4.7 system card, 16 April 2026, Example 3 | 2026-10-09 20:54 (does not expire) | open the PDF and search “Example 3” | The vendor’s own account of a staff-reported case |
Synthetic authority, report and observation controls
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-88 | The authored pack defines 27 deterministic signed controls with 15 separate conclusions, immutable JSON inputs and a separately selected policy. Its gate targets Python 3.14.7, a built and installed wheel, Vectors 0.17.6 and a pinned Verify reader. Six selected-text coverage controls use the installed external-process rail. | examples/authority-effect/authority_effect/fixtures/manifest.json; authority_effect/reader.py, coverage_bridge.py, scripts/run-gate.sh, pyproject.toml, uv.lock, docs/INPUT-CONTRACT.md and README.md in that directory |
2026-10-09 (does not expire) | In the example, run bash scripts/run-gate.sh; compare regenerated bytes, each expected conclusion, installed API/CLI outputs, all subprocess outputs and the complete dependency audit inventory |
Finite author-created synthetic controls and a qualification procedure. Public fixture keys, caller-selected policy and supplied times, reports and observations do not establish live dispatch, independent observation, trusted time, outside operation, adoption or commercial use. Counts define the pack; they are not a claim that an unrecorded gate passed. |
| P-89 | Four pinned submissions motivate the authored controls. PriorSeal’s standalone declared-hash recovery remains separate from its producer’s reconstructed commitment. AEOESS candidate-suite host adoption remains separate from draft adoption and dispatch. Frequency’s supplied comparisons remain separate from independent evidence. The scanner’s printed truncation remains separate from exit status. Producer licenses are MIT for PriorSeal, Frequency and scanner, and Apache-2.0 for federation-port; the authored pack is Apache-2.0. | examples/authority-effect/SOURCE-PINS.json; docs/SOURCE-MAP.md, controls/priorseal-tampered-intent.mjs and LICENSE in that directory; the linked exact upstream source revisions |
2026-10-09 (does not expire) | Inspect the pinned license/source bytes and file digests; copy the retained PriorSeal control into its pinned checkout and run it against the unchanged synthetic fixture; compare original/tampered preimages and both reader results | Source-bound interpretation and synthetic controls. No production verifier bypass, full deployed scanner test, independent observation or signature qualification of Frequency, specification adoption, customer pilot or commercial agreement is inferred. Separate authorship and operation require their own evidence. |
| P-90 | The separate supplied-claim control defines all 12 decision/report/observation cells and 16 invalid-Boolean refusals. Current observation is compared with the requested effect; the required post-decision state remains unsupplied. Pico’s dated report discloses a cold replay of the unchanged original nine cases and three test groups operated by Pico AI under Håkon Åmdal. | examples/authority-effect/authority_effect/frequency_fixtures/manifest.json; frequency_claims.py, scripts/generate_frequency_fixtures.py, tests/test_frequency_claims.py and docs/FREQUENCY-CONTROL.md in that directory; Pico’s report; original Frequency source at f5bc64d883564ac5cc6f23f96d346ed8ad6528ae |
2026-10-09 (does not expire) | Run the installed frequency-controls command and compare all cells, API/CLI outputs, input hashes and explicit refusals; read the dated outside-operation report separately from the original source and our own replay |
Authored synthetic assertions and exposed reference labels, not independently verified authorization, signatures or observations. A requested-effect difference can accompany a correct refusal. The source report does not establish semantic agreement, native maintained CI, production execution, host adoption or a commercial result. |
| P-91 | The installed qualification procedure checks complete package and wheel-metadata populations and exact source bytes, independently of the recorded archive hash. It refuses changed, missing or additional payloads, unsafe wheel members and installed symlinks. | examples/authority-effect/authority_effect/distribution.py; tests/test_distribution.py, scripts/qualify.py and docs/INPUT-CONTRACT.md in that directory |
2026-10-10 (does not expire) | Run the finite package gate; compare the selected wheel with the installed payload inventory and inspect the actual edited, missing and additional payload refusal controls | A selected-artifact source-byte comparison. The installer rewrites RECORD and creates its installation records; generated bytecode is excluded. This is a procedure definition, not an unrecorded gate pass, independently operated result or proof against a compromised runtime. |
| P-92 | The revised qualification checks installed package, metadata and launcher bytes before target imports. Controlled module, API and installed console routes start Python in isolated mode with a new private empty cache prefix. The gate specifies wheel and source installs on Python 3.14.7 and 3.13.16, legitimate and changed unchecked-hash cache twins, nonempty supplied-prefix controls and direct-console namespace controls. | examples/authority-effect/scripts/qualify.py; scripts/cache_controls.py, scripts/run-gate.sh, authority_effect/isolated.py, authority_effect/errors.py, bin/probity-authority-effect-cases, tests/test_isolated.py and docs/INPUT-CONTRACT.md in that directory |
2026-10-10 (does not expire) | Run the complete package gate; inspect actual interpreter flags, pre-import cache profiles, preserved cache bytes, source refusals and each installed route’s result | Procedure definition with a selected trusted artifact and baseline interpreter. Existing source-byte identity alone does not establish executed bytecode identity. Arbitrary caller imports remain caller-owned. No unrecorded installed gate pass, sandbox, independent operation, outside adoption or commercial result is claimed. |
| P-93 | The register update of 11 October retains Probity’s independently written and operated reader for the corrected 20 Agent Passport cases at 407ca2d5ad10c846860ad1b6faafc971ae9690e5. Source observations are 4 valid, 14 invalid and 2 indeterminate; reader outcomes are 4 valid, 11 invalid, 3 indeterminate and 2 unsupported. There are no unexpected diagnostic mismatches; three declared full-outcome differences and five separate upstream draft annotations remain. The reader does not import the APS SDK and uses cryptography 50.0.2/OpenSSL. |
experiments/aps-corrected20-2026-10-10/report.json, provenance.json, source-manifest.json, selected-source.zip, read_corpus.py, producer/agent-passport-vectors-v2.json, producer/README.md and python-runtime.json; original report timestamp 2026-10-10T23:46:37.900318+00:00 |
2026-10-11 (does not expire) | Check all register artifact hashes and report pointers with python3 tools/check_lab.py; inspect all 20 case identities, separate outcome populations, exposed canonical preimages and all five upstream annotations; replay the finite reader with the retained hash requirements and Python 3.14.7 |
Finite public synthetic corpus consumption. Expected answers were exposed, and raw checks and grading were emitted together. PASS means bounded diagnostic agreement, not uniform full verdicts or general JCS conformance. Supplied resolver answers do not establish authenticated history, principal binding, independent cryptographic backend, federation enrollment, release, host adoption or commercial agreement. |
| P-94 | The same original overall APS run is adverse: both selected SDK invocations stopped before corpus evaluation at a 109-byte IPC path, and the original locked npm audit reported three high package entries from two advisories. All 40 selected source files are retained unchanged, with 37 original upstream bindings and three Probity files. | experiments/aps-corrected20-2026-10-10/original-native-result.json, sdk-c31.stderr, sdk-348.stderr, npm-audit.json, npm-runtime.json, source-manifest.json, source-after.json, provenance.json and selected-source.zip; original native result timestamp 2026-10-10T23:46:57.388688+00:00 |
2026-10-11 (does not expire) | Read exact step exits and retained stderr; count the audit entries and distinct GHSA IDs; compare all source capsule members with the original before/after manifests and upstream source identities | The independent Python reader result remains a separate layer. SDK corpus and ambiguous-key characterization remain unexercised; the dependency audit does not establish exercised exploitation. No whole-SDK package qualification or repair pass is inferred, and original source dates and adverse bytes remain unchanged. |
| P-96 | The unchanged public Client fixture passed all 6 cases at SDK base b022522089a0c8b632595c6e7b536453945ed5a9 and candidate cccc1091873f730455f8d5f8f4c5e9fe5244b0ab. The first selected call requested 2 provider validators on the base and 1 on the candidate, with no additional request on reuse. Both pins accepted a valid called tool alongside an unusable uncalled schema and accepted invalid output with a cold empty cache. |
lab-cases/mcp2998/results/cccc109/report.json, base.tap, head.tap and manifest.json; unchanged fixture source at ece6bded7399177202a69efe90f5bbf80a264f6a; lab-cases/mcp2998/qualify-current-head.sh |
2026-10-11 (does not expire) | Copy the fixture and qualification shell file into a disposable TypeScript SDK checkout and run bash lab-cases/mcp2998/qualify-current-head.sh; compare the exact SDK pins, fixture hashes and original per-case output |
Finite Probity-written and Probity-operated two-tool consumer fixture. Provider requests are not Ajv compilation counts or latency measurements; the REA 170-tool catalog is separate. Malformed uncalled-schema tolerance is present on both pins. No universal output validation, upstream merge, SDK release, host adoption or commercial result is inferred. Published TAP files are byte-identified extracts; the complete infrastructure log stays private, and its pool-driver entry digest was not measured. |
Independent M1 consumer
| id | claim as printed | source | read (UTC) | re-derive | limit |
|---|---|---|---|---|---|
| P-98 | The independent M1 consumer agrees with all 12 frozen fixture decisions: three bound results and nine refusals. It preserves the native CONTRADICTED outcome, report identity, commitment, sequence, explicit selection and claim ceiling. The producer source and input digests are frozen in INPUT-MANIFEST.json. | interop/trace-m1/retained/public-report.json; INPUT-MANIFEST.json; merged producer contribution |
2026-10-11 21:36 UTC (does not expire) | In interop/trace-m1, run bash scripts/qualify.sh; count every result row and compare native fields and ceilings; inspect the fixed input manifest |
Probity authored and operated a second implementation outside REMORA after reading the producer protocol and expected cases. Bounded public synthetic known-answer replay, not answer-blind evidence, native-result truth, workload identity, authority, effects, TRACE conformance, outside host adoption or a commercial agreement. Refusal-code equivalence is not assumed. |
| P-99 | The final consumer preparation passed 118 controls and per-file coverage for all seven production modules. Controls include invalid signing points, Boolean sequences, extra fields, changed report selection and unsupported claim upgrades. The public report omits upstream expected mappings and declared context bodies, while retaining the full local report digest. | interop/trace-m1/retained/QUALIFICATION.json; adjacent original qualification streams and coverage.json; src/, tests/ and scripts/qualify.sh in the same unit |
2026-10-11 21:36 UTC (does not expire) | Run the locked qualification command; inspect every native gate exit, full control output, per-file coverage and public/full report digest join; compare each source hash with the retained preparation | Controls test the original consumer against supplied and constructed records. A malformed pinned-key counterexample motivated the point checks; it is not an exploit of the fixed upstream fixtures or a deployment claim. The linked JSON profile restricts strings to ASCII, integers to its safe range, array sizes and canonical base64; the request/mapping readers restrict retention to P1Y. Signature verification uses Ed25519 and the supported string serializer is narrower than general JCS. Third-party inputs are fetched with pinned digests and are not redistributed in this source unit. The qualification shell reserves its output directory and refuses prior result paths before writing logs; the separate hermetic custody check is not a fixture qualification. |