Skip to content

WinRate

autogen.beta.eval.pairwise.WinRate dataclass #

WinRate(variant, rate, wins, losses, ties, n, ci)

Variant B's win-rate on one key (ties count 0.5), with a Wilson 95% CI.

variant instance-attribute #

variant

rate instance-attribute #

rate

wins instance-attribute #

wins

losses instance-attribute #

losses

ties instance-attribute #

ties

n instance-attribute #

n

ci instance-attribute #

ci