Skip to content

TraceRef

autogen.beta.eval.sources.trace_source.TraceRef dataclass #

TraceRef(trace_id, task_id=None, metadata=dict())

A handle to one trace in a source, plus the bits needed to grade it.

task_id joins the trace back to a :class:~autogen.beta.eval.Task in a :class:~autogen.beta.eval.Suite (for reference-based scorers); it is None for traces with no associated dataset task (e.g. captured production traffic, graded reference-free).

trace_id instance-attribute #

trace_id

task_id class-attribute instance-attribute #

task_id = None

metadata class-attribute instance-attribute #

metadata = field(default_factory=dict)