FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-32

License and Llama Use Statement

This model is a quantized version of meta-llama/Llama-3.1-405B-Instruct.

Built with Llama.

This repository provides quantized weights for research and deployment evaluation. The model is subject to the Llama 3.1 Community License and Meta's Acceptable Use Policy. Users must comply with the license terms of the original Llama 3.1 model, including applicable use restrictions, attribution requirements, and acceptable-use requirements.

Llama 3.1 is licensed under the Llama 3.1 Community License, Copyright 漏 Meta Platforms, Inc. All Rights Reserved.

This repository is not affiliated with, endorsed by, or sponsored by Meta.

Downloads last month
23
Safetensors
Model size
67B params
Tensor type
I32
BF16
I64
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-32

Quantized
(37)
this model