Architecture

Ortavox is built to seamlessly orchestrate high-throughput, ultra-low latency audio streaming between your end clients and upstream AI models.

System Overview

Ortavox Architecture

Components

Frontend Clients

Your end-users can connect to Ortavox from multiple interfaces:

  • Mobile & Browser: Using the Ortavox Client SDKs via WebRTC.
  • Telephony: Standard SIP trunking for inbound and outbound calls.

Ortavox Core

The engine that powers it all. It handles secure websocket/WebRTC connections, Media Handling, LLM orchestration, and your custom Business Logic (Tools).

AI Providers

Ortavox proxies audio and text securely to leading AI providers (OpenAI, Deepgram, ElevenLabs, etc) while maintaining persistent websocket connections to minimize latency.