Instructions to use macrae/meta-llama2-chat-7b-hf-rk3588 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RKLLM
How to use macrae/meta-llama2-chat-7b-hf-rk3588 with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
| license: llama2 | |
| tags: | |
| - llama2 | |
| - llama2-7b | |
| - rkllm | |
| - rockchip | |
| - rk3588 | |
| # Llama 2 Chat 7B for RK3588 | |
| This is a conversion from https://huggingface.co/meta-llama/Llama-2-7b-chat-hf to the RKLLM format for Rockchip devices. | |
| This runs on the NPU from the RK3588. | |
| Converted with **RKLLM runtime 1.0.1** using docker template from https://huggingface.co/Pelochus | |
| # License | |
| Same as the original LLM: | |
| https://huggingface.co/meta-llama/Llama-2-7b-chat-hf/blob/main/LICENSE.txt | |