• Picks
  • Discover
  • Alternatives
  • About

© 2026 Willet

  • Newsletter
  • About
  • FAQ
  • Terms
  • Privacy & Cookies
Join the Discord (opens in a new tab)
Hugging Face avatar

Speech To Speech

Local voice agent pipeline chaining VAD, speech recognition, LLM and TTS

  • AI media
  • Agent frameworks and tools
  • AI models and runtimes
View on GitHub

What it is

A Python package that runs a spoken conversation loop on your own computer: voice activity detection, transcription, a language model reply, and synthesized speech, with each stage swappable for other open models. Its server implements the OpenAI Realtime protocol, reachable over WebSocket or WebRTC, which lets existing Realtime clients, the OpenAI Agents SDK, or LiveKit Agents connect to a local machine instead. Developers building voice assistants, robots, or avatars use it to keep audio and models offline without API keys.

Images

Facts

Stars
13,527 GitHub stars.
13,527

Forks
1,729
Commits
1,554
Contributors
66
Language
Python
License
Apache-2.0
Last commit
Oct 20, 2026
On GitHub since
August 2024
First release
February 2026
Platforms
macOS, Windows, Linux, CLI, self-hosted, library
Self-hostable
Yes
Alternative to
OpenAI API
Tags
  • voice-assistant
  • text-to-speech
  • llm-inference
  • speech-to-text
  • ai-agents
  • local-ai

Last synced from GitHub on Oct 20, 2026

The 10 best overlooked open-source projects, every Monday.

Share and more

Comments

No comments yet. Start the conversation.

Similar projects

  • NVIDIA Corporation avatar

    PersonaPlex

    Full-duplex speech-to-speech model with prompt-set roles and voices

    11.2k
  • Stream avatar

    Vision Agents

    Python framework for real-time voice and video AI agents

    8.2k
  • vb avatar

    Insanely Fast Whisper

    Command-line tool for fast on-device Whisper audio transcription

    13.1k

What people are saying

Updated Oct 21, 2026
  • Hacker NewsHugging Face tackles speech-to-speechSep 3, 2024 · 27 points · 5 comments (opens Hacker News in a new tab)
  • Bluesky“huggingface / speech-to-speech Build local voice agents with open-source models”Jul 23, 2026 · 2 likes · 1 reply (opens Bluesky in a new tab)
  • Bluesky“We compare E2E (Moshi us.moshi.chat) & cascaded ( dialogue systems through user study with global corpus level statistics! Moshi: small gaps, some overlap—but…”Mar 5, 2025 · 0 likes · 1 reply (opens Bluesky in a new tab)
  • Bluesky“Introducing #HuggingFace's #Speech to Speech #library! 🔥 Modular, #crossplatform pipeline to run GPT4o-like experiences on device, 100% #private! all w/ as…”Aug 21, 2024 · 1 like · 0 replies (opens Bluesky in a new tab)
  • Bluesky“9. CryptanalysisBench Evaluates LLM Cryptographic Capabilities LINK 10. Hugging Face speech-to-speech repository for local voice agents LINK”Jul 29, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“Hugging Face tackles speech-to-speech Discussion”Sep 3, 2024 · 0 likes · 0 replies (opens Bluesky in a new tab)