Skip to content

RunsNotComparableError

autogen.beta.eval.results.diff.RunsNotComparableError #

Bases: ValueError

Raised by RunResult.diff(..., strict=True) when the runs didn't grade the same eval.

The message itemizes every mismatch and notes that strict=False will diff the overlap instead.