Surfaces
CLI
Verify repos from your terminal or a CI gate. Zero dependencies.
The calma CLI is a zero-dependency (stdlib-only) client for the engine.
pip install calma
export CALMA_API_KEY=calma_sk_... # from https://calma1.vercel.app/dashboard/keys
Commands
calma verify owner/repo --deep # re-run + recompute every number
calma scans # your recent scans
calma get <scan-id> # one scan's verdict summary
calma logs <scan-id> # the full run log
calma verify flags
| Flag | Meaning |
|---|---|
--deep | re-run the repo (vs a fast, no-run validity check) |
--entry <cmd> | entrypoint override, e.g. run.py (auto-detected otherwise) |
--pip <pkg> | extra dependency (repeatable) |
--artifact-repro | verify committed result files regenerate ("re-run the paper") |
--no-wait | submit and return immediately |
--json | print the raw job JSON |
Use it as a CI gate
calma verify … --deep exits non-zero if any number fails to reproduce (REFUTED / INVALIDATED), so it drops straight into CI:
# .github/workflows/verify.yml
- run: pip install calma
- run: calma verify ${{ github.repository }} --deep
env:
CALMA_API_KEY: ${{ secrets.CALMA_API_KEY }}
Drop --deep for a fast, no-run validity check (leakage / trivial baseline / misreport). For the no-execution PR check, see the GitHub Action.