Instructions to use Pelochus/qwen1.5-chat-4B-rk3588 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RKLLM
How to use Pelochus/qwen1.5-chat-4B-rk3588 with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Qwen1.5 Chat 4B for RK3588
This is a conversion from https://huggingface.co/Qwen/Qwen1.5-4B-Chat to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM https://huggingface.co/Qwen/Qwen1.5-4B-Chat
- Downloads last month
- 12
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support