Instructions to use AI4Chem/ChemVLM-26B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use AI4Chem/ChemVLM-26B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="AI4Chem/ChemVLM-26B", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("AI4Chem/ChemVLM-26B", trust_remote_code=True, dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use AI4Chem/ChemVLM-26B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "AI4Chem/ChemVLM-26B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AI4Chem/ChemVLM-26B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/AI4Chem/ChemVLM-26B

SGLang

How to use AI4Chem/ChemVLM-26B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "AI4Chem/ChemVLM-26B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AI4Chem/ChemVLM-26B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "AI4Chem/ChemVLM-26B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AI4Chem/ChemVLM-26B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use AI4Chem/ChemVLM-26B with Docker Model Runner:
```
docker model run hf.co/AI4Chem/ChemVLM-26B
```

ChemVLM-26B

Commit History

Update README.md

5af1199
verified

Duke-de-Artois commited on Dec 19, 2025

Add pipeline tag and library name (#4)

a672e9d
verified

Duke-de-Artois

nielsr HF Staff commited on Apr 18, 2025

Update README.md

d0e2303
verified

Duke-de-Artois commited on Apr 14, 2025

Update README.md

ae1e584
verified

Duke-de-Artois commited on Apr 13, 2025

Update README.md

868a7d6
verified

Duke-de-Artois commited on Jan 17, 2025

Upload conversation.py

84f2191
verified

Duke-de-Artois commited on Jan 4, 2025

Update README.md

ab52bc3
verified

Duke-de-Artois commited on Dec 30, 2024

Update README.md

23e9902
verified

Duke-de-Artois commited on Dec 25, 2024

Update README.md

ebc80a7
verified

Duke-de-Artois commited on Dec 25, 2024

Update README.md

5d2a253
verified

Di Zhang commited on Aug 15, 2024

Update README.md

8bfa17a
verified

Di Zhang commited on Aug 15, 2024

Update README.md (#2)

ec46e05
verified

Di Zhang

lwlwlw commited on Jun 12, 2024

Update README.md (#1)

e83075a
verified

Di Zhang

lwlwlw commited on Jun 12, 2024

Update README.md

ab08acb
verified

Di Zhang commited on Jun 6, 2024

Upload folder using huggingface_hub

210248f
verified

Di Zhang commited on Jun 6, 2024

initial commit

bbf7cae
verified

Di Zhang commited on Jun 6, 2024

Commit History

Update README.md 5af1199 verified

Add pipeline tag and library name (#4) a672e9d verified

Update README.md d0e2303 verified

Update README.md ae1e584 verified

Update README.md 868a7d6 verified

Upload conversation.py 84f2191 verified

Update README.md ab52bc3 verified

Update README.md 23e9902 verified

Update README.md ebc80a7 verified

Update README.md 5d2a253 verified

Update README.md 8bfa17a verified

Update README.md (#2) ec46e05 verified

Update README.md (#1) e83075a verified

Update README.md ab08acb verified

Upload folder using huggingface_hub 210248f verified

initial commit bbf7cae verified

Update README.md

5af1199
verified

Add pipeline tag and library name (#4)

a672e9d
verified

Update README.md

d0e2303
verified

Update README.md

ae1e584
verified

Update README.md

868a7d6
verified

Upload conversation.py

84f2191
verified

Update README.md

ab52bc3
verified

Update README.md

23e9902
verified

Update README.md

ebc80a7
verified

Update README.md

5d2a253
verified

Update README.md

8bfa17a
verified

Update README.md (#2)

ec46e05
verified

Update README.md (#1)

e83075a
verified

Update README.md

ab08acb
verified

Upload folder using huggingface_hub

210248f
verified

initial commit

bbf7cae
verified