Translation
Transformers
Safetensors
ONNX
m2m_100
text2text-generation
nllb-200
nllb
quantization
int8
4-bit precision
nf4
bitsandbytes
transformers-js
multilingual
neural-machine-translation
meta
seq2seq
Instructions to use rudrakshrakeshzodage/nllb-200-distilled-600M-fp32 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use rudrakshrakeshzodage/nllb-200-distilled-600M-fp32 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("translation", model="rudrakshrakeshzodage/nllb-200-distilled-600M-fp32")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("rudrakshrakeshzodage/nllb-200-distilled-600M-fp32") model = AutoModelForSeq2SeqLM.from_pretrained("rudrakshrakeshzodage/nllb-200-distilled-600M-fp32", device_map="auto") - Notebooks
- Google Colab
- Kaggle
NLLB-200 Distilled 600M β FP32 Full Precision Baseline
π Live Web Demo: Try 100% offline in your browser at
huggingface.co/spaces/rudrakshrakeshzodage/nllb-200-onnx-browser-demo
This model is part of a suite of optimized/quantized versions of the base model. Other variants in this direction:
- FP32 (Full Precision / Base):
rudrakshrakeshzodage/nllb-200-distilled-600M-fp32(Current)- FP16 (Half Precision):
rudrakshrakeshzodage/nllb-200-distilled-600M-fp16- INT8 (Dynamic Quantization - CPU):
rudrakshrakeshzodage/nllb-200-distilled-600M-int8-cpu- NF4 (4-bit GPU Quantization):
rudrakshrakeshzodage/nllb-200-distilled-600M-nf4-4bit-gpu
Base model: facebook/nllb-200-distilled-600M
Precision: FP32 (32-bit Float Baseline)
Languages: 200 (all NLLB-200 supported languages)
πΎ Model Size Reduction Comparison (FP32 vs FP16 vs INT8 vs NF4)
π 200+ Language Performance Benchmark Chart
π Citation & Credits
Quantization research and benchmarking by RudrakshRakeshZodage.
- Downloads last month
- 84
Model tree for rudrakshrakeshzodage/nllb-200-distilled-600M-fp32
Base model
facebook/nllb-200-distilled-600M
