Skip to content

human_pairwise

autogen.beta.eval.scorers.human_pairwise.human_pairwise #

human_pairwise(*, key, ask=None, seed=None)

An inline comparator that asks a human per case (terminal ask by default).

Source code in autogen/beta/eval/scorers/human_pairwise.py 
105
106
107
def human_pairwise(*, key: str, ask: AskHuman | None = None, seed: int | None = None) -> PairwiseComparator:
    """An inline comparator that asks a human per case (terminal ``ask`` by default)."""
    return _HumanInline(key, ask or _terminal_ask, random.Random(seed))