Ultravox

Ultravox is a multi-module language model that can process both text and human speech directly without the need for a separate voice recognition (ASR) stage. It expands open-weight language models with a projector that converts sound directly into high-dimensional space that the model uses. The default model is based on Llama 3.3 70B, which takes audio as input and produces text output in flow.