Open source · Self-hosted
The evidence store for coding agents.
Sediment (sediment.so) is the open-source, self-hosted evidence store for coding agents. It captures model calls, developer decisions, edits, commits, and continuous integration (CI) outcomes as immutable Facts. Evaluate agent work, store context agents can query, and build proprietary training datasets.
curl -fsSL https://sediment.so/install.sh | sh Install
Run it locally in five commands.
zsh · ~/your-repo
curl -fsSL https://sediment.so/install.sh | sh sediment server sediment login http://127.0.0.1:8000 sediment install . # configures git hooks sediment doctor .
Capture
Capture five signals, depending on the agent.
- inference call
- Capture each prompt, response, and model from your gateway.
- developer decision
- Record every accept and reject, human or automatic.
- edit
- Measure how much of each edit survives the session.
- commit and push
- Link commits to sessions through git notes or similarity.
- ci outcome
- Record check results across runs and retries.
See the architecture diagram
Report
-
Which model works better?
Compare each model's CI pass rate and how often its calls reach a commit.
sediment report model -
Did accepted work reach a commit?
Follow the work you accept through commits, merged pull requests, and CI.
sediment report lifecycle --json -
How much code survived?
Measure how much agent code remains after review and merge. SWE-chat (October 1, 2026) found that 59% of agent-produced code survived into user commits, in sessions collected from public repositories.
sediment report merge-retention -
What needs rework?
Count rejects, retries, changed or deleted edits, outside changes, and CI failures separately.
sediment report lifecycle --json -
What went into a failed CI run?
Trace the failure to its commit, sessions, and the model calls that likely contributed.
sediment commit COMMIT_SHA
Export
training data
Export SFT, DPO, and RLVR datasets. Trace every label back to its evidence.
See training exports
How Sediment turns coding-agent activity into training data · How CI outcomes become RLVR training data
Agents
supported today
Check what Sediment records from each agent.
| Agent | Decisions | Commit attribution | Inference calls | Edits |
|---|---|---|---|---|
| Claude Code | Accept and reject | Yes | Through a gateway | Optional |
| Codex | Accept and reject | Yes | Through a gateway | Single-file patches |
| Cursor | Implicit accepts | Yes | No | No |
| pi | Implicit accepts | Yes | Through a gateway | Optional |
| Copilot Chat | Accept, reject, retention | No | No | No |