Skip to content

human_labels

autogen.beta.eval.scorers.human_pairwise.human_labels #

human_labels(path, *, criterion, key)

A comparator reading human labels for one criterion from a manifest JSONL.

Source code in autogen/beta/eval/scorers/human_pairwise.py 
100
101
102
def human_labels(path: str, *, criterion: str, key: str) -> PairwiseComparator:
    """A comparator reading human labels for one criterion from a manifest JSONL."""
    return _HumanLabels(path, criterion, key)