CI & pull requests

GitHub Action

A fail-closed validity check on every pull request. Free, no run.

The Calma GitHub Action runs a no-execution validity check on every PR: it recomputes committed numbers and catches data leakage, trivial/degenerate baselines, and misreports — without building or running the repo. It's free and fail-closed.

Add .github/workflows/calma.yml:

name: Calma validity check
on: [pull_request]
jobs:
  calma:
    runs-on: ubuntu-latest
    permissions:
      contents: read
      pull-requests: write
    steps:
      - uses: actions/checkout@v4
      - uses: rikhinkavuru/calma@v1
        with:
          fail-on: fail       # fail | incomplete | never
          comment: true       # post a report-card comment on the PR

Inputs

Input	Default	Meaning
`path`	`.`	subdirectory to scan
`fail-on`	`fail`	fail the check on a validity problem (`fail`), also when nothing is checkable (`incomplete`), or never (`never`)
`comment`	`true`	post/update a report-card comment on the PR

The action outputs grade (PASS / FAIL / INCOMPLETE). For a full re-run + recompute in CI (not just the no-run validity check), use the CLI as a step instead.