Instructions to use macrae/Llama-3-2-3B-rk3588 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RKLLM
How to use macrae/Llama-3-2-3B-rk3588 with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
metadata
license: llama3.2
tags:
- llama3.2
- llama3.2-3B
- rkllm
- rockchip
- rk3588
Llama 3.2 3B for RK3588
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.
RKLLM runtime 1.1.1 requires NPU driver 0.9.6:
RKLLM runtime 1.1.4 requires NPU driver 0.9.8:
License
Same as the original LLM:
https://huggingface.co/meta-llama/Meta-Llama-3.2-3B/blob/main/LICENSE.txt