RKLLM Runtime 1.1.1
Collection
Model collections converted with RKLLM Runtime 1.1.1, requieres NPU Driver version 0.9.6 • 3 items • Updated
Llama 3 Instruct 8B for RK3588
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.
Converted with RKLLM runtime 1.1.1
License
Same as the original LLM:
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/blob/main/LICENSE.txt
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js