Anny: Assisting AutoGen Devs Via AutoGen
TL;DR
We are adding a new sample app called Anny-- a simple Discord bot powered by AutoGen that's intended to assist AutoGen Devs. See samples/apps/auto-anny for details.
Tools#
AutoGenBench -- A Tool for Measuring and Evaluating AutoGen Agents
AutoGenBench is a standalone tool for evaluating AutoGen agents and workflows on common benchmarks.
TL;DR
Today we are releasing AutoGenBench - a tool for evaluating AutoGen agents and workflows on established LLM and agentic benchmarks.
AutoGenBench is a standalone command line tool, installable from PyPI, which handles downloading, configuring, running, and reporting supported benchmarks. AutoGenBench works best when run alongside Docker, since it uses Docker to isolate tests from one another.
- See the AutoGenBench README for information on installation and running benchmarks.
- See the AutoGenBench CONTRIBUTING guide for information on developing or contributing benchmark datasets.
AutoGen Studio: Interactively Explore Multi-Agent Workflows
AutoGen Studio: Solving a task with multiple agents that generate a pdf document with images.
TL;DR
To help you rapidly prototype multi-agent solutions for your tasks, we are introducing AutoGen Studio, an interface powered by AutoGen. It allows you to:
- Declaratively define and modify agents and multi-agent workflows through a point and click, drag and drop interface (e.g., you can select the parameters of two agents that will communicate to solve your task).
- Use our UI to create chat sessions with the specified agents and view results (e.g., view chat history, generated files, and time taken).
- Explicitly add skills to your agents and accomplish more tasks.
- Publish your sessions to a local gallery.
See the official AutoGen Studio documentation for more details.
AutoGen Studio is open source code here, and can be installed via pip. Give it a try!