Willow Inference Server
Open SourceApache-2.0Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS,…
Difficulty
●● MediumLast check
2026-02-12Description
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
Preview
Platforms
LinuxDocker
Replaces the following proprietary tools
ChatGPT API→Willow Inference Server
Midjourney→Willow Inference Server
DALL-E→Willow Inference Server
Self-Hosting
Willow Inference Server can be self-hosted on your own infrastructure. Visit the official documentation for installation instructions.
Documentation →Categories
Tags
#cuda#deep-learning#llama#llm#privacy#speech-recognition#speech-to-text