Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
RedHatAI
/
NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
like
4
Follow
Red Hat AI
3.03k
Text Generation
Safetensors
nemotron_h
int4
w4a16
quantized
llm-compressor
compressed-tensors
red hat
conversational
License:
nvidia-open-model-license
Model card
Files
Files and versions
xet
Community
2
Copy to bucket
new
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (1)
Sort: Recently created
Great! Sucessfully Running on 8*48G 4090Ti: Avg generation throughput: 221.5 tokens/s, Running: 4 reqs
3
#1 opened 3 months ago by
nwzjk
