Realtime voice agent platform
How to use
LiveKit.
Building low-latency voice assistants, multimodal room participants, phone agents, realtime translation, tool-using conversational workflows, and human handoffs.
LiveKit is a Open-source realtime framework and cloud platform for voice, video, text, telephony, and multimodal AI agents. Building low-latency voice assistants, multimodal room participants, phone agents, realtime translation, tool-using conversational workflows, and human handoffs. This guide covers the whole path in one place: official access, a first session that produces something reviewable, the checks that make output trustworthy, and the permissions worth limiting before you connect real work.
AI should make the work easier to inspect. If the workflow removes the source, the owner, or the review step, redesign the workflow.
Access & setup
Find, install, and sign in to LiveKit
Get into the official LiveKit experience with the right account and a setup you understand.
- 01
Start at https://livekit.io/ and confirm the domain before entering account or payment information.
- 02
Availability: LiveKit Agents is available through Python and Node.js SDKs, a browser-based Agent Builder and console, LiveKit Cloud deployment and inference, or self-hosted LiveKit infrastructure.
- 03
A supported development environment or cloud project, secure LiveKit and model credentials, authorized voice and telephony data, latency and interruption testing, consent, observability controls, and a human escalation path.
- 04
Sign in with the account you intend to keep using, then review plan, data, notification, and permission settings.
- 05
Run one low-risk test task before connecting sensitive files, repositories, or workspace data.
- Use official download pages.
- Review permissions during setup.
- Keep installers and applications updated.
First session
Your first useful LiveKit session
Learn the interaction loop using a small task with a clear outcome.
- 01
Define the caller, purpose, allowed topics, identity disclosure, languages, latency, interruption behavior, tools, consent, recording, retention, accessibility, and human handoff.
- 02
Prototype with minimum synthetic data and the simplest STT-LLM-TTS or realtime pipeline, keeping credentials server-side and every tool read-only or sandboxed.
- 03
Test noisy audio, silence, accents, crosstalk, barge-in, hallucination, unsafe requests, tool failures, latency, disconnection, and escalation while capturing approved metrics.
- 04
Add authentication, authorization, disclosure, redaction, rate and spend limits, monitoring, emergency stop, and human review before a narrow production canary.
- State the outcome before the background.
- Provide the real source material.
- Review the result before expanding the task.
Quality control
Check the quality of LiveKit output
Turn a promising generation into an asset you can legally and safely ship.
- 01
Restate the brief, the deliverable format, and where the asset will appear before judging any output.
- 02
Inspect at full resolution: generated media hides its errors at thumbnail size.
- 03
Check the details these systems reliably get wrong — hands, text, logos, reflections, symmetry, and edge artefacts.
- 04
Confirm the licence and commercial-use terms for your plan, and check the output does not reproduce a recognisable style, mark, or likeness you have no right to use.
- 05
Review for accessibility and delivery: alt text, contrast, colour profile, file size, and the exact export format.
- Inspect at full resolution before approving anything.
- Confirm commercial-use rights before an asset reaches a client.
- Keep the prompt and settings with the asset so it can be reproduced.
Privacy & permissions
Use LiveKit safely
Use the platform without surrendering rights, likenesses, or client material you do not control.
- 01
Confirm you hold the rights to every reference image, voice, or clip before uploading it.
- 02
Check whether your plan trains on submitted content, and opt out before uploading client work.
- 03
Never upload a real person's likeness or voice without their explicit, documented consent.
- 04
Review the output for marks, styles, or likenesses you have no licence to reproduce.
- 05
Label synthetic media where your client, platform, or jurisdiction requires disclosure.
- Realtime agents can hear, transcribe, infer, speak, call tools, and initiate telephony actions before a reviewer can intervene. Hidden observation, recording, voice cloning, payment or identity collection, and cross-provider routing carry serious consent and privacy risk. LiveKit Inference is zero-data-retention by default, but plugins, observability, recordings, telephony, and external models have separate policies. Require clear disclosure, least-privilege tools, explicit confirmation, human handoff, and an immediate kill switch.
- Follow your organisation's approved-use policy.
- Never treat fluent output as authorization to act.
Core workflows
Step-by-step ways to use LiveKit for the work it does best.
Each workflow is a separate guide with its own steps and review checkpoints.
Design a low-latency conversation that discloses automation, handles interruptions, limits tools, and reaches a human safely.
↗ 02 WorkflowOperate a resilient LiveKit telephony agentTake a tested voice agent onto phone networks with call authorization, fraud controls, observability, fallback, and emergency shutdown.
↗Official references
Check the current product documentation.
Features, plan limits, availability, and data controls change. These official pages are the starting points used for this guide.
- LiveKit Agents introduction ↗
- Voice AI quickstart ↗
- LiveKit model overview ↗
- LiveKit Agent Console privacy ↗