Probity AI

Check claims about agent actions.

Probity builds evidence tools for agent harnesses, reviewers and platform teams. Use them to define claims, test verifiers, inspect action records and apply workload policy.

Choose a project for your task, or find a retained run by its claims, roles and limits.

The public code

Task	Start with
Define an evidence claim	Vocabulary
Test a verifier	Vectors
Record file actions or check delegation runs	Observer
Check a supplied claim	Verify
Apply workload admission policy	Admission
Work with canonical JSON or signature envelopes	jcs-admit and dsse

The task page links a pinned quickstart for each project. For scripts and agents, use the automation guide, llms.txt or project catalog.

Choose by task: Vocabulary defines evidence terms; Vectors tests verifier cases; Observer records actions; Verify checks supplied claims; Admission applies workload policy; jcs-admit handles canonical JSON; dsse handles signature envelopes; Atlas publishes mechanisms and retained runs. These are entry points, not a required sequence.

Replay an evidence decision to inspect a retained signed packet, admit it once and reproduce the replay, authority and signature refusals. The walkthrough checks the decision from recorded bytes; it does not execute the original agent action.

Inspect accepted our bounded native result reader listing on October 3, 2026. The live extensions catalog still shows the earlier published source (checked October 5). Read the pinned consumer guide.

Read why a green test suite can contain negative conclusions. The worked example separates a correct test, a valid record and the result of an action, with retained files and a checking procedure.

Agent action assurance

The assurance atlas maps the mechanisms teams use to control agents and check their actions. The Open Evidence Lab publishes run artifacts, replay commands and review state. Experiments document the procedure behind each recorded check.

Sources and re-derive commands live in the claim ledger. The version ledger records each artifact and its release state.

Research

Three Jobs, Not One explains why deciding, containing and witnessing agent execution need separate mechanisms (Zenodo).

Sankalp Gilda and Shlok Gilda, Position: Evaluation Scores Are Perishable Knowledge Claims, GEM (paper).

Working in the repository covers the sources and checks; maintaining the catalog covers new project entries.