Text Generation
Transformers
Safetensors
English
nemotron_labs_audex
nvidia
nemotron-labs-audex
reasoning
general-purpose
SFT
RL
audio-language-modeling
audio-understanding
text-to-speech
text-to-audio
speech-recognition
speech-translation
Instructions to use Mattral/Nemotron-Labs-Audex-30B-A3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Mattral/Nemotron-Labs-Audex-30B-A3B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Mattral/Nemotron-Labs-Audex-30B-A3B")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Mattral/Nemotron-Labs-Audex-30B-A3B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Mattral/Nemotron-Labs-Audex-30B-A3B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Mattral/Nemotron-Labs-Audex-30B-A3B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Mattral/Nemotron-Labs-Audex-30B-A3B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Mattral/Nemotron-Labs-Audex-30B-A3B
- SGLang
How to use Mattral/Nemotron-Labs-Audex-30B-A3B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Mattral/Nemotron-Labs-Audex-30B-A3B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Mattral/Nemotron-Labs-Audex-30B-A3B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Mattral/Nemotron-Labs-Audex-30B-A3B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Mattral/Nemotron-Labs-Audex-30B-A3B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Mattral/Nemotron-Labs-Audex-30B-A3B with Docker Model Runner:
docker model run hf.co/Mattral/Nemotron-Labs-Audex-30B-A3B
| #!/usr/bin/env python3 | |
| # coding=utf-8 | |
| # Copyright (c) 2026, NVIDIA CORPORATION. All rights reserved. | |
| # | |
| # Licensed under the Apache License, Version 2.0 (the "License"); | |
| # you may not use this file except in compliance with the License. | |
| # You may obtain a copy of the License at | |
| # | |
| # http://www.apache.org/licenses/LICENSE-2.0 | |
| # | |
| # Unless required by applicable law or agreed to in writing, software | |
| # distributed under the License is distributed on an "AS IS" BASIS, | |
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
| # See the License for the specific language governing permissions and | |
| # limitations under the License. | |
| """CLI launcher for Audex Enhancement VAE""" | |
| from __future__ import annotations | |
| import argparse | |
| from pathlib import Path | |
| import torch | |
| from enhancement_vae import DEFAULT_CHECKPOINT, DEFAULT_CONFIG, enhance_file, iter_input_files, load_model | |
| def parse_args() -> argparse.Namespace: | |
| script_dir = Path(__file__).resolve().parent | |
| parser = argparse.ArgumentParser(description="Enhance XCodec1-decoded 16 kHz WAVs to 48 kHz.") | |
| parser.add_argument("--input", type=Path, required=True, help="Input audio file or directory.") | |
| parser.add_argument("--output-dir", type=Path, required=True, help="Directory for enhanced 48 kHz WAVs.") | |
| parser.add_argument("--device", type=str, default="cuda" if torch.cuda.is_available() else "cpu") | |
| parser.add_argument("--seed", type=int, default=0, help="Torch seed for stochastic VAE sampling.") | |
| parser.add_argument("--deterministic", action="store_true", help="Use posterior mean instead of VAE sampling.") | |
| parser.set_defaults( | |
| checkpoint=script_dir / DEFAULT_CHECKPOINT, | |
| config=script_dir / DEFAULT_CONFIG, | |
| ) | |
| return parser.parse_args() | |
| def main() -> None: | |
| args = parse_args() | |
| torch.manual_seed(args.seed) | |
| device = torch.device(args.device) | |
| model = load_model(checkpoint_path=args.checkpoint, config_path=args.config, device=device) | |
| input_files = iter_input_files(args.input) | |
| if not input_files: | |
| raise ValueError(f"No audio files found in {args.input}") | |
| for input_path in input_files: | |
| output_path = args.output_dir / f"{input_path.stem}_enhanced_48k.wav" | |
| enhance_file(model, input_path, output_path, deterministic=args.deterministic) | |
| print(f"{input_path} -> {output_path}") | |
| if __name__ == "__main__": | |
| main() | |