RKLLM Runtime 1.1.4
Collection
Model collections converted with RKLLM Runtime 1.1.4, requieres NPU Driver version 0.9.8 • 3 items • Updated
How to use macrae/Llama-3-2-1B-rk3588 with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-1B to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.
RKLLM runtime 1.1.1 requires NPU driver 0.9.6:
RKLLM runtime 1.1.4 requires NPU driver 0.9.8:
Same as the original LLM:
https://huggingface.co/meta-llama/Meta-Llama-3.2-1B/blob/main/LICENSE.txt