CLI v1

Commands used in onboarding and CI.

Core commands

eval-dashboards init
eval-dashboards teach
eval-dashboards lint --input=.evals_output
eval-dashboards check --input=.evals_output
eval-dashboards report --input=.evals_output --reporter=html --reporter=json-summary
eval-dashboards report-index --input=.evals_output --out=eval-dashboard/overview.html
eval-dashboards publish --target=dir --input=.evals_output --report-dir=eval-dashboard
eval-dashboards completion install
eval-dashboards import --from=promptfoo --input=./promptfoo-results.json --out=.evals_output/import-promptfoo.json
eval-dashboards merge --input=.evals_output --out=eval-report/merged.json
eval-dashboards history --input=.evals_output --out=eval-report/history.json
eval-dashboards adjudicate export --input=.evals_output --out=eval-report/adjudication-bundle.json
eval-dashboards report --input=.evals_output --reporter=html --profile=guardrail --report-dir=eval-report

init flags (agent-quality preset)

--preset=agent-quality
--setup=guardrails,evals,judges,multiturn
--runner=vitest|jest|node|python
--ci=github|azure|none
--write
--playbook
--dry-run
--teach
--out-dir=<path>
--force

Exit codes

  • 0 pass
  • 1 gates failed
  • 2 invalid config/artifact/options
  • 3 no reports found