Open source · Self-hosted

The evidence store for coding agents.

Sediment (sediment.so) is the open-source, self-hosted evidence store for coding agents. It captures model calls, developer decisions, edits, commits, and continuous integration (CI) outcomes as immutable Facts. Evaluate agent work, store context agents can query, and build proprietary training datasets.

curl -fsSL https://sediment.so/install.sh | sh

Install

Run it locally in five commands.

zsh · ~/your-repo

curl -fsSL https://sediment.so/install.sh | sh
sediment server
sediment login http://127.0.0.1:8000
sediment install .    # configures git hooks
sediment doctor .

Quickstart · Deploy for a team

Capture

Capture five signals, depending on the agent.

inference call
Capture each prompt, response, and model from your gateway.
developer decision
Record every accept and reject, human or automatic.
edit
Measure how much of each edit survives the session.
commit and push
Link commits to sessions through git notes or similarity.
ci outcome
Record check results across runs and retries.

See the architecture diagram

Report

  1. Which model works better?

    Compare each model's CI pass rate and how often its calls reach a commit.

    sediment report model
  2. Did accepted work reach a commit?

    Follow the work you accept through commits, merged pull requests, and CI.

    sediment report lifecycle --json
  3. How much code survived?

    Measure how much agent code remains after review and merge. SWE-chat (October 1, 2026) found that 59% of agent-produced code survived into user commits, in sessions collected from public repositories.

    sediment report merge-retention
  4. What needs rework?

    Count rejects, retries, changed or deleted edits, outside changes, and CI failures separately.

    sediment report lifecycle --json
  5. What went into a failed CI run?

    Trace the failure to its commit, sessions, and the model calls that likely contributed.

    sediment commit COMMIT_SHA

How to measure agent work

Export

training data

Export SFT, DPO, and RLVR datasets. Trace every label back to its evidence.

See training exports

How Sediment turns coding-agent activity into training data · How CI outcomes become RLVR training data

Agents

supported today

Check what Sediment records from each agent.

AgentDecisionsCommit attributionInference callsEdits
Claude Code Accept and reject YesThrough a gatewayOptional
Codex Accept and reject YesThrough a gatewaySingle-file patches
Cursor Implicit accepts YesNoNo
pi Implicit accepts YesThrough a gatewayOptional
Copilot Chat Accept, reject, retention NoNoNo

See agent integrations