Install and import
pnpm add @icodenet/eval-dashboards
import {
validateEvalReport,
summarizeReport,
checkGates,
createEvalReportArtifact,
writeEvalReportArtifact,
} from '@icodenet/eval-dashboards';
Core model exports
EvalReportV1,EvalRow,EvalRun,EvalSuiteSummarySuiteManifest,GatePolicy,RiskArea,DatasetSource,GraderKindTraceReference,ConversationTurn,ToolCallEVAL_REPORT_SCHEMA_VERSION,rowKey,rowMatchedExpectation,summarizeReport
Validation, history, and gating
validateEvalReport(ValidationResult)assessBaselineCompatibilitybuildHistory,compareRuns(RunHistoryEntry,RunComparison)checkGates(GateConfig,GateResult)lintReportTaxonomy,lintReportsTaxonomy(TaxonomyLintResult)
Reporting, publishing, and config
renderGroupedIndexHtmlpublishReport(PublishOptions,PublishResult,PublishTarget)loadConfig,mergeConfig(EvalReportsConfig)BUILT_IN_THEMES,resolveTheme(EvalReportsTheme)formatDate,formatPassRate,formatDuration,formatCount
Adapters and adjudication
createEvalReportArtifact,writeEvalReportArtifactRunnerEvalResult,RunnerEvalCaseResultexportUnresolvedRowsBundle,mergeAdjudicationBundle,validateAdjudicationBundle