Skip to content

Tutorial: your first canonical benchmark

Goal

Run a complete benchmark over the three canonical panel studies using bundled snapshots.

Step 1: create a spec

python -m tscfbench make-canonical-spec --data-source snapshot --no-external -o canonical.json

Step 2: run the benchmark

python -m tscfbench run-canonical canonical.json -o canonical_results.json

Step 3: render the report

python -m tscfbench render-canonical-report canonical.json -o canonical_report.md

What to inspect

  • whether the treated unit and intervention year are correct,
  • whether the pre-period fit is acceptable,
  • whether placebo p-values are informative,
  • whether one model dominates across all studies or only on one dataset.

Next step

Swap --data-source snapshot for --data-source auto when you are ready to try remote mirrors.