MCPcopy
hub / github.com/pipecat-ai/pipecat

github.com/pipecat-ai/pipecat @v1.4.0 sqlite

repository ↗ · DeepWiki ↗ · release v1.4.0 ↗
12,272 symbols 66,767 edges 1,080 files 8,123 documented · 66%
README

pipecat

PyPI Tests codecov Docs Discord Ask DeepWiki

🎙️ Pipecat: Real-Time Voice & Multimodal AI Agents

Pipecat is an open-source Python framework for building real-time voice and multimodal conversational agents. Build a single voice agent or a full multi-agent system where specialists hand off, fan out in parallel, and coordinate over a shared bus, locally or distributed across processes and machines. Orchestrate audio and video, AI services, transports, and conversation pipelines effortlessly, so you can focus on what makes your agents unique.

Want to dive right in? Run pipecat create quickstart or follow the quickstart guide.

🚀 What You Can Build

  • Voice Assistants – natural, streaming conversations with AI
  • Multi-Agent Systems – specialists that hand off, fan out in parallel, or run as sidecars over a shared bus
  • AI Companions – coaches, meeting assistants, characters
  • Multimodal Interfaces – voice, video, images, and more
  • Interactive Storytelling – creative tools with generative media
  • Business Agents – customer intake, support bots, guided flows
  • Complex Dialog Systems – design logic with structured conversations

🧠 Why Pipecat?

  • Voice-first: Integrates speech recognition, text-to-speech, and conversation handling
  • Pluggable: Supports many AI services and tools
  • Composable Pipelines: Build complex behavior from modular components
  • Multi-Agent Ready: Each pipeline is an agent. Compose them with handoff, parallel fan-out, sidecar workers, or distributed deployments
  • Real-Time: Ultra-low latency interaction with different transports (e.g. WebSockets or WebRTC)

🌐 Pipecat Ecosystem

📱 Client SDKs

Building client applications? You can connect to Pipecat from any platform using our official SDKs:

JavaScript | React | React Native | Swift | Kotlin | C++ | ESP32

🧭 Structured conversations

Looking to build structured conversations? Check out Pipecat Flows for managing complex conversational states and transitions.

🪄 Beautiful UIs

Want to build beautiful and engaging experiences? Checkout the Voice UI Kit, a collection of components, hooks and templates for building voice AI applications quickly.

🛠️ Create and deploy projects

The Pipecat CLI ships with pipecat-ai — install it with uv tool install "pipecat-ai[cli]". Scaffold a project in under a minute with pipecat create, or run pipecat init to make a project agent-ready so an AI coding assistant (Claude Code, Codex) builds it for you. Then use the CLI to monitor and deploy your agent to production.

🔍 Debugging

Looking for help debugging your pipeline and processors? Check out Whisker, a real-time Pipecat debugger.

🖥️ Terminal

Love terminal applications? Check out Tail, a terminal dashboard for Pipecat.

🤖 Claude Code Skills

Use Pipecat Skills with Claude Code to scaffold projects, deploy to Pipecat Cloud, and more. Install the marketplace with:

claude plugin marketplace add pipecat-ai/skills

and install any of the available plugins.

🧩 Community Integrations

Build and share your own Pipecat service integrations! Browse existing community integrations or check out our guide to create your own.

📺️ Pipecat TV Channel

Catch new features, interviews, and how-tos on our Pipecat TV channel.

🎬 See it in action

<a href="https://github.com/pipecat-ai/pipecat-examples/tree/main/simple-chatbot"><img src="https://raw.githubusercontent.com/pipecat-ai/pipecat-examples/main/simple-chatbot/image.png" width="400" /></a>&nbsp;
<a href="https://github.com/pipecat-ai/pipecat-examples/tree/main/storytelling-chatbot"><img src="https://raw.githubusercontent.com/pipecat-ai/pipecat-examples/main/storytelling-chatbot/image.png" width="400" /></a>



<a href="https://github.com/pipecat-ai/pipecat-examples/tree/main/daily-multi-translation"><img src="https://raw.githubusercontent.com/pipecat-ai/pipecat-examples/main/daily-multi-translation/image.png" width="400" /></a>&nbsp;
<a href="https://github.com/pipecat-ai/pipecat/blob/main/examples/vision/vision-moondream.py"><img src="https://github.com/pipecat-ai/pipecat/blob/main/examples/assets/moondream.png" width="400" /></a>

🧩 Available services

Category Services
Speech-to-Text AssemblyAI, AWS, Azure, Cartesia, Deepgram, ElevenLabs, Fal Wizper, Gladia, Google, Gradium, Groq (Whisper), Mistral, Moonshine, NVIDIA, OpenAI (Whisper), Sarvam, Soniox, Speechmatics, Whisper, xAI
LLMs Anthropic, AWS, Azure, Cerebras, DeepSeek, Fireworks AI, Gemini, Grok, Groq, Inception, Mistral, Nebius, Novita, NVIDIA NIM, Ollama, OpenAI, [OpenAI Responses](https://docs.pipecat.ai/api-reference/server/servi

Extension points exported contracts — how you extend this code

AppProps (Interface)
(no doc)
src/pipecat/cli/templates/client/react-nextjs/src/app/components/App.tsx
TransportSelectProps (Interface)
(no doc)
src/pipecat/cli/templates/client/react-nextjs/src/app/components/TransportSelect.tsx
AppProps (Interface)
(no doc)
src/pipecat/cli/templates/client/react-vite/src/components/App.tsx
TransportSelectProps (Interface)
(no doc)
src/pipecat/cli/templates/client/react-vite/src/components/TransportSelect.tsx

Core symbols most depended-on inside this repo

get
called by 632
src/pipecat/runner/types.py
get
called by 451
src/pipecat/services/cartesia/stt.py
add_message
called by 418
src/pipecat/processors/aggregators/llm_context.py
add_workers
called by 386
src/pipecat/workers/runner.py
run
called by 378
src/pipecat/workers/runner.py
cancel
called by 354
src/pipecat/workers/runner.py
_call_event_handler
called by 336
src/pipecat/utils/base_object.py
main
called by 330
src/pipecat/runner/run.py

Shape

Method 7,616
Function 2,656
Class 1,953
Route 43
Interface 4

Languages

Python99%
TypeScript1%

Modules by API surface

src/pipecat/transports/daily/transport.py197 symbols
src/pipecat/frames/frames.py176 symbols
tests/test_word_completion_tracker.py155 symbols
tests/test_vonage_video_connector.py142 symbols
tests/test_get_llm_invocation_params.py135 symbols
tests/test_settings.py118 symbols
tests/test_base_worker.py110 symbols
src/pipecat/processors/aggregators/llm_response_universal.py107 symbols
tests/test_context_aggregators_universal.py101 symbols
src/pipecat/transports/livekit/transport.py95 symbols
tests/test_tts_frame_ordering.py91 symbols
tests/test_ui_worker.py88 symbols

Dependencies from manifests, versioned

@pipecat-ai/client-js1.10.0 · 1×
@pipecat-ai/small-webrtc-transport1.10.3 · 1×
vite8.0.16 · 1×
loguru0.7.3 · 1×
onnxruntime1.24.3 · 1×
pyloudnorm0.2.0 · 1×
resampy0.4.3 · 1×
soxr1.0.0 · 1×
typing_extensions4.9 · 1×
websockets13.1 · 1×

For agents

$ claude mcp add pipecat \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact