About OmniHuman 2.0
OmniHuman 2.0 is ByteDance's audio-driven human animation model: it turns a single image and a voice track into a video of the subject speaking or singing, with lip sync, facial expression, and body gesture that follow the rhythm and meaning of the audio.
It works from any framing, from close-up portraits to full-body shots, and on photographs as well as illustrated, 3D-rendered, and non-human characters. Images with several people produce multi-person scenes. An optional text prompt directs camera movement, specific actions, and added elements that are not in the source image; prompts can be written in English, Chinese, Japanese, Korean, Mexican Spanish, or Indonesian.
The video runs as long as the audio, from 4 seconds up to 5 minutes, and is billed per second of output. Output is 720p-class with its aspect ratio following the input image. Audio must be WAV or MP3 under 15 MB; the image must be between 300 and 6000 pixels per side with an aspect ratio between 0.4 and 2.5.
| Metric | Value |
|---|---|
| Parameter Count | Unknown |
| Mixture of Experts | Unknown |
| Context Length | 4 to 300 seconds of audio |
| Multilingual | Yes (prompts in 6 languages; speech in any language) |
| Quantized* | Unknown |
*Quantization refers to whether the served weights are reduced-precision.
See what this model can do
A handful of real prompts and their outputs.
Ready to build with OmniHuman 2.0?
Try OmniHuman 2.0 in the Workbench to prompt it, compare outputs, and iterate on prompts without writing any code. When you're ready to ship, call the same model from our API and build your own apps on top of it.
curl -sSf -X POST https://hub.oxen.ai/api/ai/videos/generate \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $OXEN_API_KEY" \
-d '{
"model": "bytedance-omnihuman-2-0",
"input_image": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/ox_zoom_out_1926_1076.png",
"input_audio": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/audios/example.mp3"
}'Request parameters
Every field OmniHuman 2.0 accepts in the request body. See the API reference for response formats.
https://hub.oxen.ai/api/ai/videos/generate| Field | Type | Required | Default | Description |
|---|---|---|---|---|
prompt | string | No | — | Optional direction for camera movement, actions, and added elements. |
input_image | stringuri | Yes | — | The person or character to animate. |
input_audio | stringuri | Yes | — | Speech or singing that drives the performance. |