Image-Text-to-Text
Transformers
Safetensors
kimi_k3
feature-extraction
compressed-tensors
conversational
custom_code
8-bit precision
Instructions to use AtomicChat/Kimi-K3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AtomicChat/Kimi-K3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="AtomicChat/Kimi-K3", trust_remote_code=True) messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AtomicChat/Kimi-K3", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use AtomicChat/Kimi-K3 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AtomicChat/Kimi-K3" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AtomicChat/Kimi-K3", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/AtomicChat/Kimi-K3
- SGLang
How to use AtomicChat/Kimi-K3 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "AtomicChat/Kimi-K3" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AtomicChat/Kimi-K3", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "AtomicChat/Kimi-K3" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AtomicChat/Kimi-K3", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use AtomicChat/Kimi-K3 with Docker Model Runner:
docker model run hf.co/AtomicChat/Kimi-K3
| Kimi K3 License | |
| Copyright (c) 2026 Moonshot AI | |
| Permission is hereby granted, free of charge, to any person (the "Licensee") | |
| obtaining a copy of this software — including the model weights, parameters, | |
| configuration files, inference and training code, and associated documentation | |
| (collectively, the "Software") — to deal in the Software without restriction. | |
| This includes, without limitation, the rights to use, copy, modify, merge, | |
| publish, distribute, sublicense, and/or sell copies of the Software; to run, | |
| deploy, fine-tune, or otherwise modify the Software and create derivative works | |
| from it; and to permit persons to whom the Software is furnished to do so, in | |
| each case subject to the following conditions: | |
| 1. The above copyright notice and this permission notice shall be included in | |
| all copies or substantial portions of the Software. Licensee's use of the | |
| Software must comply with applicable laws and regulations. | |
| 2. "Model as a Service" means giving a third party access to language model | |
| inference or fine-tuning (e.g., via API) in a manner that allows such third | |
| party to exercise meaningful control over the inputs, parameters, or training | |
| data. This does not include (a) end-user products with model capabilities solely | |
| embedded within specific features or harnesses, or (b) mere relaying of requests | |
| to models hosted by others. | |
| If the Licensee or any of its affiliates operates a Model as a Service business, | |
| and the aggregate revenue of the Licensee and its affiliates exceeds 20 million | |
| US dollars (or the equivalent in other currencies) in total over any consecutive | |
| 12 months, the Licensee must enter into a separate agreement with Moonshot AI | |
| before using the Software or its derivative works for any commercial purpose. | |
| 3. If the Software (or any derivative works thereof) is used for any of the | |
| Licensee's commercial products or services that have more than 100 million | |
| monthly active users, or more than 20 million US dollars (or equivalent in other | |
| currencies) in monthly revenue, "Kimi K3" must be prominently displayed on the | |
| user interface of such product or service. | |
| 4. The requirements set forth in Sections 2 and 3 do not apply to: (a) internal | |
| use of the Software, defined as any use that does not make the Software, its | |
| outputs, or its underlying capabilities available to third parties; or (b) any | |
| use of the Software accessed through Moonshot AI's official products or | |
| certified inference partners. | |
| 5. THE SOFTWARE AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” | |
| BASIS, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT | |
| LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE | |
| AND NONINFRINGEMENT. IN NO EVENT SHALL MOONSHOT AI OR ITS AFFILIATES OR | |
| COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER | |
| IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN | |
| CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. | |
| For any questions regarding this license, please contact <license@moonshot.ai>. |