RKLLM Runtime 1.1.4
Collection
Model collections converted with RKLLM Runtime 1.1.4, requieres NPU Driver version 0.9.8 • 3 items • Updated
How to use macrae/llama3-8b-cpt-sahabatai-v1-instruct with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
This is a conversion from Sahabat-AI Llama3 8B Instruct model to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.
RKLLM runtime 1.1.4 requires NPU driver 0.9.8:
License: Llama3 Community License