Spaces:
Runtime error
Runtime error
File size: 4,279 Bytes
ce6e449 97d0511 ce6e449 97d0511 ce6e449 5391979 97d0511 5391979 ce6e449 97d0511 5391979 97d0511 5391979 2dc3606 5391979 2dc3606 97d0511 5391979 97d0511 5391979 97d0511 5391979 97d0511 7a407b5 97d0511 5391979 7a407b5 5391979 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 | ---
title: LTX-2.3 Turbo
emoji: ⚡
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: 5.23.0
python_version: '3.12'
app_file: app.py
pinned: true
license: other
license_name: ltx-2-community-license-agreement
license_link: https://github.com/Lightricks/LTX-2/blob/main/LICENSE
short_description: Generate video + audio with LTX-2.3 (22B) on free ZeroGPU
tags:
- video-generation
- audio-generation
- text-to-video
- image-to-video
- ltx
- lightricks
- zerogpu
- fp8
- distilled
models:
- Lightricks/LTX-2.3
---
# LTX-2.3 Turbo (ZeroGPU)
Generate synchronized **video + audio** from text or images using
[Lightricks/LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3) — a **22B
parameter** DiT-based audio-video foundation model — running entirely on
**free ZeroGPU** hardware. No paid GPU required.
**~10 seconds** to generate a 2-second video with audio at 768x512.
## Features
- **Text to Video** — describe a scene and get video with synchronized audio
- **Image to Video** — provide a first frame and animate it with audio
- **Prompt enhancement** — Gemma-3 12B rewrites your prompt for better results
- **Multiple resolutions** — 16:9, 1:1, and 9:16 aspect ratios
- **Reproducible** — set a seed for consistent outputs
## How it works
This Space uses a **vendored packages + pre-loaded models** strategy to fit
the massive 22B model on ZeroGPU's A10G (40GB VRAM):
1. **Startup**: Downloads model files, constructs `ModelLedger`, loads the
Gemma-3 12B text encoder, and pre-loads the FP8-quantized transformer +
video encoder into the pipeline cache.
2. **Text Encoding** (`@spaces.GPU`): Encodes the prompt into video/audio
context tensors using the pre-loaded text encoder, returned to CPU.
3. **Video Generation** (`@spaces.GPU`): Runs the two-stage distilled
denoising pipeline (8 steps low-res + 4 steps high-res with 2x spatial
upscaling) using pre-encoded contexts, then decodes video and audio.
### Key optimizations
| Optimization | Details |
|---|---|
| **FP8 quantization** | Transformer weights cast to `float8_e4m3fn`, halving VRAM usage |
| **Distilled pipeline** | Only 8+4 denoising steps (vs 30+ for full model) |
| **Pre-loaded models** | Text encoder, transformer, video encoder loaded once at startup |
| **Two-stage upscaling** | Generates at half resolution, then upscales 2x with spatial upsampler |
| **Vendored packages** | `ltx-core` and `ltx-pipelines` bundled for fast builds |
## Parameters
| Parameter | Range | Default | Notes |
|-----------|-------|---------|-------|
| Mode | Text to Video / Image to Video | Text to Video | |
| Prompt | Free text | — | Describe scene, motion, and audio |
| Resolution | 768x512, 512x512, 512x768 | 768x512 | Upscaled 2x by spatial upscaler |
| Duration | 1-5 seconds | 2s | Shorter = more reliable on ZeroGPU |
| Enhance prompt | On/Off | On | Gemma-3 rewrites prompt for better results |
| Seed | 0-2B | Random | For reproducibility |
## Limitations
- **ZeroGPU time limits**: Longer videos may exceed the GPU lease duration.
Keep duration at 3 seconds or less for best reliability.
- **VRAM constraints**: Even with FP8 quantization, very high resolutions
are not possible. The preset resolutions are tuned for ZeroGPU.
- **No audio conditioning**: This simplified interface doesn't support
custom audio input (the full model does).
## Duplicating this Space
This Space uses [google/gemma-3-12b-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-3-12b-it-qat-q4_0-unquantized)
as the text encoder. Before duplicating, you must:
1. Accept the [Gemma license](https://huggingface.co/google/gemma-3-12b-it-qat-q4_0-unquantized) on your HuggingFace account
2. Create a **read-access** HuggingFace token and add it as a Space secret named `HF_TOKEN`
## Credits
- **Model**: [Lightricks/LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3) (22B parameters)
- **Text encoder**: [google/gemma-3-12b-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-3-12b-it-qat-q4_0-unquantized) (requires accepting Google's Gemma license)
- **Codebase**: [Lightricks/LTX-2](https://github.com/Lightricks/LTX-2)
- **ZeroGPU architecture** inspired by [alexnasa/ltx-2-TURBO](https://huggingface.co/spaces/alexnasa/ltx-2-TURBO)
|