Instructions to use Pelochus/qwen2-1_5B-rk3588 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RKLLM
How to use Pelochus/qwen2-1_5B-rk3588 with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Qwen 2 1.5B for RK3588
This is a conversion from https://huggingface.co/Qwen/Qwen2-1.5B to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588
Latest update: June 2024. Converted with RKLLM runtime 1.0.1.
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM https://huggingface.co/Qwen/Qwen2-1.5B
- Downloads last month
- 28
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support