macrae
/

meta-llama2-chat-13b-hf-rk3588

Model card Files Files and versions

Llama 2 Chat 13B for RK3588

This is a conversion from https://huggingface.co/meta-llama/Llama-2-13b-chat-hf to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.

Converted with RKLLM runtime 1.0.1 using docker template from https://huggingface.co/Pelochus

License

Same as the original LLM:

https://huggingface.co/meta-llama/Llama-2-13b-chat-hf/blob/main/LICENSE.txt

Downloads last month: 9

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including macrae/meta-llama2-chat-13b-hf-rk3588

RKLLM Runtime 1.0.1

Model collections converted with RKLLM Runtime 1.1.1, requieres NPU Driver version 0.9.6 Model collections converted with RKLLM Runtime 1.0.1 • 2 items • Updated Jun 4, 2025