VariantRunResult
autogen.beta.eval.runtime.variants.VariantRunResult dataclass #
Result of :func:run_variants: a per-variant :class:RunResult plus ranking helpers.
leaderboard #
Variants ranked best-first by scorer key (pass-rate for boolean, mean for numeric).
Tied scores share a rank (competition ranking — 1, 1, 1, 4).
Source code in autogen/beta/eval/runtime/variants.py
best #
Top-ranked variant for key — or None when the top score is shared (no unique winner).
Source code in autogen/beta/eval/runtime/variants.py
summary #
Printable ranked leaderboard for key.