FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-128

License and Llama Use Statement

This model is a quantized version of meta-llama/Llama-3.1-405B-Instruct.

Built with Llama.

This repository provides quantized weights for research and deployment evaluation. The model is subject to the Llama 3.1 Community License and Meta's Acceptable Use Policy. Users must comply with the license terms of the original Llama 3.1 model, including applicable use restrictions, attribution requirements, and acceptable-use requirements.

Llama 3.1 is licensed under the Llama 3.1 Community License, Copyright 漏 Meta Platforms, Inc. All Rights Reserved.

This repository is not affiliated with, endorsed by, or sponsored by Meta.

Downloads last month
21
Safetensors
Model size
58B params
Tensor type
BF16
I64
I32
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-128

Quantized
(37)
this model