Hugging Face's logo

amd
/
Llama-3.1-405B-Instruct-MXFP4-Preview

Safetensors
llama
8-bit precision
quark
Model card Files
xet
 Community
linzhao-amd commited on
Commit
0b02cb0
·
verified ·
1 Parent(s): 9dcf083

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -11,6 +11,8 @@ base_model:
11
  - **Output:** Text
12
  - **Supported Hardware Microarchitecture:** AMD MI350/MI355
13
  - **ROCm**: 7.0
 
 
14
  - **Preferred Operating System(s):** Linux
15
  - **Inference Engine:** [vLLM](https://docs.vllm.ai/en/latest/)
16
  - **Model Optimizer:** [AMD-Quark](https://quark.docs.amd.com/latest/index.html) (V0.9)
 
11
  - **Output:** Text
12
  - **Supported Hardware Microarchitecture:** AMD MI350/MI355
13
  - **ROCm**: 7.0
14
+ - **PyTorch**: 2.8.0
15
+ - **Transformers**: 4.53.0
16
  - **Preferred Operating System(s):** Linux
17
  - **Inference Engine:** [vLLM](https://docs.vllm.ai/en/latest/)
18
  - **Model Optimizer:** [AMD-Quark](https://quark.docs.amd.com/latest/index.html) (V0.9)