RKLLM Runtime 1.1.1
Collection
Model collections converted with RKLLM Runtime 1.1.1, requieres NPU Driver version 0.9.6 • 3 items • Updated
How to use macrae/Llama-3-8B-Instruct-rk3588 with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.
Converted with RKLLM runtime 1.1.1
Same as the original LLM:
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/blob/main/LICENSE.txt