Agreement autogen.beta.eval.pairwise.Agreement dataclass # Agreement(rate, cohen_kappa, n, disagreements) Agreement between two comparator keys (e.g. judge vs human). rate instance-attribute # rate cohen_kappa instance-attribute # cohen_kappa n instance-attribute # n disagreements instance-attribute # disagreements