All Notebooks
This page contains a collection of notebooks that demonstrate how to use AG2. The notebooks are tagged with the topics they cover. For example, a notebook that demonstrates how to use function calling will be tagged with tool/function.
Tools with Dependency Injection
Tools with Dependency Injection
Tools Dependency Injection
Chatting with a teachable agent
Chatting with a teachable agent
Learn how to persist memories across chat sessions using the Teachability capability
Solving Complex Tasks with Nested Chats
Solving Complex Tasks with Nested Chats
Solve complex tasks with a chat nested as inner monologue.
Agent Tracking with AgentOps
Agent Tracking with AgentOps
Use AgentOps to simplify the development process and monitor your agents in production.
Config loader utility functions
Config loader utility functions
Config loader utility functions
Wikipedia Agent
Wikipedia Agent
Search Wikipedia with WikipediaAgent
Websockets: Streaming input and output using websockets
Websockets: Streaming input and output using websockets
Websockets facilitate real-time, bidirectional communication between web clients and servers, enhancing the responsiveness and interactivity of AG2-powered applications.
A Uniform interface to call different LLMs
A Uniform interface to call different LLMs
Uniform interface to call different LLM.
RAG OpenAI Assistants in AG2
RAG OpenAI Assistants in AG2
OpenAI Assistant with retrieval augmentation.
From Dad Jokes To Sad Jokes: Function Calling with GPTAssistantAgent
From Dad Jokes To Sad Jokes: Function Calling with GPTAssistantAgent
Use tools in a GPTAssistantAgent Multi-Agent System by utilizing functions such as calling an API and writing to a file.
Agent Chat with custom model loading
Agent Chat with custom model loading
Define and load a custom model
Agentic RAG workflow on tabular data from a PDF file
Agentic RAG workflow on tabular data from a PDF file
Agentic RAG workflow on tabular data from a PDF file
Group Chat with Customized Speaker Selection Method
Group Chat with Customized Speaker Selection Method
Introduce group chat with customized speaker selection method.
RealtimeAgent in a Swarm Orchestration using WebRTC
RealtimeAgent in a Swarm Orchestration using WebRTC
Swarm Ochestration
Auto Generated Agent Chat: Task Solving with Code Generation, Execution, Debugging & Human Feedback
Auto Generated Agent Chat: Task Solving with Code Generation, Execution, Debugging & Human Feedback
Code generation, execution, debugging and human feedback.
Web Scraping using Apify Tools
Web Scraping using Apify Tools
Scrapping web pages and summarizing the content using agents with tools.
Swarm Orchestration with AG2
Swarm Orchestration with AG2
Swarm Ochestration
Currency Calculator: Task Solving with Provided Tools as Functions
Currency Calculator: Task Solving with Provided Tools as Functions
Learn how to register function calls using AssistantAgent and UserProxyAgent.
Use LLamaIndexQueryEngine to query Markdown files
Use LLamaIndexQueryEngine to query Markdown files
Use any LlamaIndex vector store as a Query Engine
Agent with memory using Mem0
Agent with memory using Mem0
Use Mem0 to create agents with memory.
RealtimeAgent in a Swarm Orchestration
RealtimeAgent in a Swarm Orchestration
Swarm Ochestration
Solving Complex Tasks with A Sequence of Nested Chats
Solving Complex Tasks with A Sequence of Nested Chats
Solve complex tasks with one or more sequence chats nested as inner monologue.
Auto Generated Agent Chat: Teaching AI New Skills via Natural Language Interaction
Auto Generated Agent Chat: Teaching AI New Skills via Natural Language Interaction
Teach the agent news skills using natural language.
(Legacy) Implement Swarm-style orchestration with GroupChat
(Legacy) Implement Swarm-style orchestration with GroupChat
(Legacy) Implement Swarm-style orchestration with GroupChat
Use AG2 to Tune ChatGPT
Use AG2 to Tune ChatGPT
Use AG2 to Tune ChatGPT
Perplexity Search Tool
Perplexity Search Tool
Perplexity Search Integration with AG2
Perform Research with Multi-Agent Group Chat
Perform Research with Multi-Agent Group Chat
Perform research using a group chat with a number of specialized agents.
Usage tracking with AG2
Usage tracking with AG2
cost calculation
Auto Generated Agent Chat: Collaborative Task Solving with Coding and Planning Agent
Auto Generated Agent Chat: Collaborative Task Solving with Coding and Planning Agent
Use planning agent in a function call.
DeepSeek: Adding Browsing Capabilities to AG2
DeepSeek: Adding Browsing Capabilities to AG2
DeepSeek: Adding Browsing Capabilities to AG2
Chat with OpenAI Assistant using function call in AG2: OSS Insights for Advanced GitHub Data Analysis
Chat with OpenAI Assistant using function call in AG2: OSS Insights for Advanced GitHub Data Analysis
This Jupyter Notebook demonstrates how to leverage OSS Insight (Open Source Software Insight) for advanced GitHub data analysis by defining `Function calls` in AG2 for the OpenAI Assistant.
RealtimeAgent with gemini client
RealtimeAgent with gemini client
RealtimeAgent with gemini client using websockets
Solving Multiple Tasks in a Sequence of Async Chats
Solving Multiple Tasks in a Sequence of Async Chats
Use conversational agents to solve a set of tasks with a sequence of async chats.
Group Chat with Tools
Group Chat with Tools
Group Chat with Tools
Agent with memory using Mem0
Agent with memory using Mem0
Use Mem0 to create agents with memory.
Adding YouTube Search Capability to AG2
Adding YouTube Search Capability to AG2
YouTube Search Integration with AG2
OpenAI Assistants in AG2
OpenAI Assistants in AG2
Two-agent chat with OpenAI assistants.
Demonstrating the `AgentEval` framework using the task of solving math problems as an example
Demonstrating the `AgentEval` framework using the task of solving math problems as an example
AgentEval: a multi-agent system for assessing utility of LLM-powered applications
Adding Browsing Capabilities to AG2
Adding Browsing Capabilities to AG2
Adding Browsing Capabilities to AG2
Group Chat with Retrieval Augmented Generation
Group Chat with Retrieval Augmented Generation
Implement and manage a multi-agent chat system using AG2, where AI assistants retrieve information, generate code, and interact collaboratively to solve complex tasks, especially in areas not covered by their training data.
Cross-Framework LLM Tool Integration with AG2
Cross-Framework LLM Tool Integration with AG2
Cross-Framework LLM Tool Integration with AG2
Auto Generated Agent Chat: GPTAssistant with Code Interpreter
Auto Generated Agent Chat: GPTAssistant with Code Interpreter
This Jupyter Notebook showcases the integration of the Code Interpreter tool which executes Python code dynamically within applications.
Auto Generated Agent Chat: Task Solving with Langchain Provided Tools as Functions
Auto Generated Agent Chat: Task Solving with Langchain Provided Tools as Functions
Use Langchain tools.
Using Neo4j's graph database with AG2 agents for Question & Answering
Using Neo4j's graph database with AG2 agents for Question & Answering
Neo4j GraphRAG utilises a knowledge graph and can be added as a capability to agents.
Run a standalone AssistantAgent
Run a standalone AssistantAgent
Run a standalone AssistantAgent, browsing the web using the BrowserUseTool
StateFlow: Build Workflows through State-Oriented Actions
StateFlow: Build Workflows through State-Oriented Actions
StateFlow: Build workflows through state-oriented actions.
Using RetrieveChat for Retrieve Augmented Code Generation and Question Answering
Using RetrieveChat for Retrieve Augmented Code Generation and Question Answering
Explore the use of AG2's RetrieveChat for tasks like code generation from docstrings, answering complex questions with human feedback, and exploiting features like Update Context, custom prompts, and few-shot learning.
ReasoningAgent - Advanced LLM Reasoning with Multiple Search Strategies
ReasoningAgent - Advanced LLM Reasoning with Multiple Search Strategies
Use ReasoningAgent for o1 style reasoning in Agentic workflows with LLMs using AG2
Use AG2 to Tune OpenAI Models
Use AG2 to Tune OpenAI Models
Use AG2 to Tune OpenAI Models
Generate Dalle Images With Conversable Agents
Generate Dalle Images With Conversable Agents
Generate images with conversable agents.
DeepResearchAgent
DeepResearchAgent
DeepResearch Agent
Enhanced Swarm Orchestration with AG2
Enhanced Swarm Orchestration with AG2
Swarm Ochestration
Structured output from json configuration
Structured output from json configuration
OpenAI offers a functionality for defining a structure of the messages generated by LLMs, AutoGen enables this functionality by propagating response_format passed to your agents to the underlying client.
Agent Observability with OpenLIT
Agent Observability with OpenLIT
Use OpenLIT to easily monitor AI agents in production with OpenTelemetry.
Use ChromaDBQueryEngine to query Markdown files
Use ChromaDBQueryEngine to query Markdown files
ChromaDB Query Engine for document queries
Auto Generated Agent Chat: Solving Tasks Requiring Web Info
Auto Generated Agent Chat: Solving Tasks Requiring Web Info
Solve tasks requiring web info.
Task Solving with Code Generation, Execution and Debugging
Task Solving with Code Generation, Execution and Debugging
Use conversable language learning model agents to solve tasks and provide automatic feedback through a comprehensive example of writing, executing, and debugging Python code to compare stock price changes.
Use MongoDBQueryEngine to query Markdown files
Use MongoDBQueryEngine to query Markdown files
Mongo DB Query Engine
RealtimeAgent with WebRTC connection
RealtimeAgent with WebRTC connection
RealtimeAgent using websockets
Adding Google Search Capability to AG2
Adding Google Search Capability to AG2
Google Search
Solving Multiple Tasks in a Sequence of Chats
Solving Multiple Tasks in a Sequence of Chats
Use conversational agents to solve a set of tasks with a sequence of chats.
Using RetrieveChat with Qdrant for Retrieve Augmented Code Generation and Question Answering
Using RetrieveChat with Qdrant for Retrieve Augmented Code Generation and Question Answering
This notebook demonstrates the usage of QdrantRetrieveUserProxyAgent for RAG.
Writing a software application using function calls
Writing a software application using function calls
Equip your agent with functions that can efficiently implement features into your software application.
Google Drive Tools
Google Drive Tools
Google Drive Tools
Runtime Logging with AG2
Runtime Logging with AG2
Provide capabilities of runtime logging for debugging and performance analysis.
Load the configuration including the response format
Load the configuration including the response format
Agent Quickstart Examples
Using RetrieveChat Powered by MongoDB Atlas for Retrieve Augmented Code Generation and Question Answering
Using RetrieveChat Powered by MongoDB Atlas for Retrieve Augmented Code Generation and Question Answering
Explore the use of AG2's RetrieveChat for tasks like code generation from docstrings, answering complex questions with human feedback, and exploiting features like Update Context, custom prompts, and few-shot learning.
WebSurferAgent
WebSurferAgent
WebSurfer Agent
Using FalkorGraphRagCapability with agents for GraphRAG Question & Answering
Using FalkorGraphRagCapability with agents for GraphRAG Question & Answering
Using FalkorGraphRagCapability with agents for GraphRAG Question & Answering
Auto Generated Agent Chat: Task Solving with Provided Tools as Functions
Auto Generated Agent Chat: Task Solving with Provided Tools as Functions
Register function calls using AssistantAgent and UserProxyAgent to execute python or shell code in customized ways. Demonstrating two ways of registering functions.
Preprocessing Chat History with `TransformMessages`
Preprocessing Chat History with `TransformMessages`
Preprocessing chat history with `TransformMessages`
CaptainAgent
CaptainAgent
Introducing CaptainAgent, a powerful agent that can manage and orchestrate other agents and tools to solve complex tasks.
FSM - User can input speaker transition constraints
FSM - User can input speaker transition constraints
Explore the demonstration of the Finite State Machine implementation, which allows the user to input speaker transition constraints.
OptiGuide with Nested Chats in AG2
OptiGuide with Nested Chats in AG2
This is a nested chat re-implementation of OptiGuide which is an LLM-based supply chain optimization framework.
Group Chat with Coder and Visualization Critic
Group Chat with Coder and Visualization Critic
Explore a group chat example using agents such as a coder and visualization agent.
`run` function examples with event processing
`run` function examples with event processing
Using run and event processing
Mitigating Prompt hacking with JSON Mode in Autogen
Mitigating Prompt hacking with JSON Mode in Autogen
Use JSON mode and Agent Descriptions to mitigate prompt manipulation and control speaker transition.
Translating Video audio using Whisper and GPT-3.5-turbo
Translating Video audio using Whisper and GPT-3.5-turbo
Use tools to extract and translate the transcript of a video file.
Auto Generated Agent Chat: Group Chat with GPTAssistantAgent
Auto Generated Agent Chat: Group Chat with GPTAssistantAgent
Use GPTAssistantAgent in group chat.
Interactive LLM Agent Dealing with Data Stream
Interactive LLM Agent Dealing with Data Stream
Automated continual learning from new data.
Engaging with Multimodal Models: GPT-4V in AG2
Engaging with Multimodal Models: GPT-4V in AG2
Leveraging multimodal models through two different methodologies: MultimodalConversableAgent and VisionCapability.
Using Guidance with AG2
Using Guidance with AG2
Constrained responses via guidance.
SQL Agent for Spider text-to-SQL benchmark
SQL Agent for Spider text-to-SQL benchmark
Natural language text to SQL query using the Spider text-to-SQL benchmark.
Conversational Chess using non-OpenAI clients
Conversational Chess using non-OpenAI clients
LLM-backed agents playing chess with each other using nested chats.
Group Chat
Group Chat
Explore the utilization of large language models in automated group chat scenarios, where agents perform tasks collectively, demonstrating how they can be configured, interact with each other, and retrieve specific information from external resources.
Auto Generated Agent Chat: Function Inception
Auto Generated Agent Chat: Function Inception
Function Inception: Enable AG2 agents to update/remove functions during conversations.
Making OpenAI Assistants Teachable
Making OpenAI Assistants Teachable
Teach OpenAI assistants.
Use AG2 in Databricks with DBRX
Use AG2 in Databricks with DBRX
Use Databricks DBRX and Foundation Model APIs to build AG2 applications backed by open-source LLMs.
Agent Chat with Async Human Inputs
Agent Chat with Async Human Inputs
Async human inputs.
Using RetrieveChat Powered by PGVector for Retrieve Augmented Code Generation and Question Answering
Using RetrieveChat Powered by PGVector for Retrieve Augmented Code Generation and Question Answering
Explore the use of AG2's RetrieveChat for tasks like code generation from docstrings, answering complex questions with human feedback, and exploiting features like Update Context, custom prompts, and few-shot learning.
Groupchat with Llamaindex agents
Groupchat with Llamaindex agents
Integrate llamaindex agents with Autogen.
Discord, Slack, and Telegram messaging tools
Discord, Slack, and Telegram messaging tools
Adding Browsing Capabilities to AG2
Chat Context Dependency Injection
Chat Context Dependency Injection
Chat Context Dependency Injection
Structured output
Structured output
LLM providers offer functionality for defining a structure of the messages generated by LLMs, AG2 enables this functionality by propagating a `response_format`, in the LLM configuration for your agents, to the underlying client.
Trip planning with a FalkorDB GraphRAG agent using a Swarm
Trip planning with a FalkorDB GraphRAG agent using a Swarm
FalkorDB GraphRAG utilises a knowledge graph and can be added as a capability to agents. Together with a swarm orchestration of agents is highly effective at providing a RAG capability.
RealtimeAgent in a Swarm Orchestration
RealtimeAgent in a Swarm Orchestration
Swarm Ochestration
Small, Local Model (IBM Granite) Multi-Agent RAG
Small, Local Model (IBM Granite) Multi-Agent RAG
Optimizing Small, Local LLMs in Multi-Agent RAG Workflows using IBM Granite, Document Retrieval, Web Search, and Ollama
Assistants with Azure Cognitive Search and Azure Identity
Assistants with Azure Cognitive Search and Azure Identity
This notebook demonstrates the use of Assistant Agents in conjunction with Azure Cognitive Search and Azure Identity
Supercharging Web Crawling with Crawl4AI
Supercharging Web Crawling with Crawl4AI
Supercharging Web Crawling with Crawl4AI
RealtimeAgent with local websocket connection
RealtimeAgent with local websocket connection
RealtimeAgent using websockets
Using a local Telemetry server to monitor a GraphRAG agent
Using a local Telemetry server to monitor a GraphRAG agent
FalkorDB GraphRAG utilises a knowledge graph and can be added as a capability to agents. Together with a swarm orchestration of agents is highly effective at providing a RAG capability.
AgentOptimizer: An Agentic Way to Train Your LLM Agent
AgentOptimizer: An Agentic Way to Train Your LLM Agent
AgentOptimizer is able to prompt LLMs to iteratively optimize function/skills of AutoGen agents according to the historical conversation and performance.
Using RetrieveChat Powered by Couchbase Capella for Retrieve Augmented Code Generation and Question Answering
Using RetrieveChat Powered by Couchbase Capella for Retrieve Augmented Code Generation and Question Answering
Explore the use of AG2's RetrieveChat for tasks like code generation from docstrings, answering complex questions with human feedback, and exploiting features like Update Context, custom prompts, and few-shot learning.
Using Neo4j's native GraphRAG SDK with AG2 agents for Question & Answering
Using Neo4j's native GraphRAG SDK with AG2 agents for Question & Answering
Neo4j Native GraphRAG utilizes a knowledge graph and can be added as a capability to agents.
Automatically Build Multi-agent System from Agent Library
Automatically Build Multi-agent System from Agent Library
Automatically build multi-agent system from agent library
MCP Clients
MCP Clients
MCP Clients
Nested Chats for Tool Use in Conversational Chess
Nested Chats for Tool Use in Conversational Chess
LLM-backed agents playing chess with each other using nested chats.
Task Solving with Provided Tools as Functions (Asynchronous Function Calls)
Task Solving with Provided Tools as Functions (Asynchronous Function Calls)
Learn how to implement both synchronous and asynchronous function calls using AssistantAgent and UserProxyAgent in AutoGen, with examples of their application in individual and group chat settings for task execution with language models.
SocietyOfMindAgent
SocietyOfMindAgent
Explore the demonstration of the SocietyOfMindAgent in the AG2 library, which runs a group chat as an internal monologue, but appears to the external world as a single agent, offering a structured way to manage complex interactions among multiple agents and handle issues such as extracting responses from complex dialogues and dealing with context window constraints.
Use AG2 in Microsoft Fabric
Use AG2 in Microsoft Fabric
Use AG2 in Microsoft Fabric
Wikipedia Search Tools
Wikipedia Search Tools
Perplexity Search Integration with AG2
Language Agent Tree Search
Language Agent Tree Search
Language Agent Tree Search.
Agent Chat with Multimodal Models: LLaVA
Agent Chat with Multimodal Models: LLaVA
Leveraging multimodal models like llava.
Agent Chat with Multimodal Models: DALLE and GPT-4V
Agent Chat with Multimodal Models: DALLE and GPT-4V
Multimodal agent chat with DALL-E and GPT-4v.
Auto Generated Agent Chat: Collaborative Task Solving with Multiple Agents and Human Users
Auto Generated Agent Chat: Collaborative Task Solving with Multiple Agents and Human Users
Involve multiple human users via function calls and nested chat.
RealtimeAgent in a Swarm Orchestration
RealtimeAgent in a Swarm Orchestration
Swarm Ochestration
Cross-Framework LLM Tool for CaptainAgent
Cross-Framework LLM Tool for CaptainAgent
Cross-Framework LLM Tool for CaptainAgent
Solving Multiple Tasks in a Sequence of Chats with Different Conversable Agent Pairs
Solving Multiple Tasks in a Sequence of Chats with Different Conversable Agent Pairs
Use AG2 to solve a set of tasks with a sequence of chats.
RAG with DocAgent
RAG with DocAgent
Query documents and web pages with DocAgent
Auto Generated Agent Chat: Using MathChat to Solve Math Problems
Auto Generated Agent Chat: Using MathChat to Solve Math Problems
Using MathChat to Solve Math Problems