Instructions to use internlm/Intern-S1-Pro-BF16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use internlm/Intern-S1-Pro-BF16 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="internlm/Intern-S1-Pro-BF16", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("internlm/Intern-S1-Pro-BF16", trust_remote_code=True, dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use internlm/Intern-S1-Pro-BF16 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "internlm/Intern-S1-Pro-BF16"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S1-Pro-BF16",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/internlm/Intern-S1-Pro-BF16

SGLang

How to use internlm/Intern-S1-Pro-BF16 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "internlm/Intern-S1-Pro-BF16" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S1-Pro-BF16",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "internlm/Intern-S1-Pro-BF16" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S1-Pro-BF16",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use internlm/Intern-S1-Pro-BF16 with Docker Model Runner:
```
docker model run hf.co/internlm/Intern-S1-Pro-BF16
```

haijunlv commited on Feb 14

Commit

c98bab2

verified ·

1 Parent(s): 7e66b3f

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00001-of-00153.safetensors +3 -0
model-00003-of-00153.safetensors +3 -0
model-00004-of-00153.safetensors +3 -0
model-00005-of-00153.safetensors +3 -0
model-00007-of-00153.safetensors +3 -0
model-00008-of-00153.safetensors +3 -0
model-00009-of-00153.safetensors +3 -0
model-00010-of-00153.safetensors +3 -0
model-00012-of-00153.safetensors +3 -0
model-00013-of-00153.safetensors +3 -0
model-00016-of-00153.safetensors +3 -0
model-00017-of-00153.safetensors +3 -0
model-00018-of-00153.safetensors +3 -0
model-00019-of-00153.safetensors +3 -0
model-00020-of-00153.safetensors +3 -0
model-00022-of-00153.safetensors +3 -0
model-00025-of-00153.safetensors +3 -0
model-00026-of-00153.safetensors +3 -0
model-00028-of-00153.safetensors +3 -0
model-00032-of-00153.safetensors +3 -0
model-00033-of-00153.safetensors +3 -0
model-00034-of-00153.safetensors +3 -0
model-00040-of-00153.safetensors +3 -0
model-00043-of-00153.safetensors +3 -0
model-00044-of-00153.safetensors +3 -0
model-00045-of-00153.safetensors +3 -0
model-00046-of-00153.safetensors +3 -0
model-00047-of-00153.safetensors +3 -0
model-00048-of-00153.safetensors +3 -0
model-00051-of-00153.safetensors +3 -0
model-00055-of-00153.safetensors +3 -0
model-00057-of-00153.safetensors +3 -0
model-00059-of-00153.safetensors +3 -0
model-00060-of-00153.safetensors +3 -0
model-00061-of-00153.safetensors +3 -0
model-00062-of-00153.safetensors +3 -0
model-00069-of-00153.safetensors +3 -0
model-00075-of-00153.safetensors +3 -0
model-00076-of-00153.safetensors +3 -0
model-00081-of-00153.safetensors +3 -0
model-00082-of-00153.safetensors +3 -0
model-00089-of-00153.safetensors +3 -0
model-00093-of-00153.safetensors +3 -0
model-00098-of-00153.safetensors +3 -0
model-00103-of-00153.safetensors +3 -0
model-00109-of-00153.safetensors +3 -0
model-00112-of-00153.safetensors +3 -0
model-00128-of-00153.safetensors +3 -0
model.safetensors.index.json +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text

model-00001-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9b4366159de4f7cce5532c7bfd950f20caec6fb8f951e84af5de3f0851629e38
+size 11991648488

model-00003-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:03ea52d5eccab28cf852595b9b5f2a28585e8331a95a072a6fe6b32726117a7f
+size 11995932456

model-00004-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9e5164d8a265019cfe5463179396be32219942b46c70bde60c1e3904cf36a1a9
+size 11996319920

model-00005-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e9d6cdb6d55db8c98c5f0305fdc02d965a9b9996eb780e2fcc798e628959dc8d
+size 11996319384

model-00007-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:37bef98b66f505085f7d3f44ed8ad0f8118d5c2bf42cbaf3180f438a7828ae83
+size 11991681312

model-00008-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d9d132256112a88ce5bb7b1f2e11628b611f4d7f4e319e4dc56bf0588f7ef6fc
+size 11991648960

model-00009-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:22e2e671d515406d44dd66b34f01e9c24b8353685b3d0096d71da5b073e3f0bc
+size 11991648672

model-00010-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:74b678e9dd9e5b878c0959973140c023b1c2287de18c720ccda1f17cd49949a8
+size 11991648880

model-00012-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7b77e89c481049682039b734a3ace8ee95770729413d21e69b7a0f18d36af351
+size 11991648512

model-00013-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c1a0015e547129060aaa84b1bd01e69d1573a2d858a4830d46581094a24f03cf
+size 11991648960

model-00016-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:700bd84e443e149d229bec8b2228dc721fa4ae4f8a4a9b75c9fa75174ad07fb8
+size 11991648960

model-00017-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c41e106dd42a51d6e7084327e2850afa004f60267d4d83fd55de87986f51d92f
+size 11991648624

model-00018-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:31415941d1e834e0fe565c62f71198c56ca532aca6ffe2f7e100683b2d054e34
+size 11991649464

model-00019-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1e695b91f8a7f6e79eb21bf95946c490f8034b16b156f5675697085c84817931
+size 11991649904

model-00020-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c03c1df065c8fb843b0f9e653ea298796713a462aa3fa523bb709d48ea9a162
+size 11991649528

model-00022-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:168975320506f523b245d77fd91cecfd7b75ad0e392edc5727e96e0bcafd7984
+size 11991649728

model-00025-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3c087c6eb4aa360ff93ca0361e24c8fda6e72c5a3846a23e7a02aae3228c4d81
+size 11991649528

model-00026-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:254702f85d65f7c46df84c82acc05b4209d9686785dae6722d442f8ad5a92948
+size 11991649912

model-00028-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:97c8497ac4f939f2595a14a77480e5c3836f15081059af88d7e746bf9c4442bc
+size 11991649584

model-00032-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d1cf4f17940ac2a5744b65106604cf43db07e9308cf914775e8d968278df28d1
+size 11991650032

model-00033-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3f2ef36571c89fcb6f33b749b59294f1adea8dc4f9b9ddf9d6c7588b4496b9fc
+size 11991649456

model-00034-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0a274d71f8ad1fdc5983fb3f39d3ed2cd54d6426153e2a85da36514979833c7a
+size 11991649912

model-00040-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:89bf65b3afc88f46e5058b4c559b24b70a95363631c73dadb441aa0cdcb59bad
+size 11991649976

model-00043-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:24a7201fdca3b19f26b73c7297993a43e8d7ac8078a9dad30f6300361c0bdeeb
+size 11991649768

model-00044-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5dd54f284b8ba1c2ea4bf49f843a155b17878fa8003406c73057d241674dd563
+size 11991649656

model-00045-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:53a325454165a48049452b6c0cdd8199424531592ad0c4e4ab892b93f88e2215
+size 11991649920

model-00046-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d0040ab3dd60a438d4797445f802146cb2df65e9333e71dd7180c544cda8da56
+size 11991649560

model-00047-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5df35acf89f89d586ff1e0a8c06f386af2f728753125be1ad61eaa77edb8dbc1
+size 11991649920

model-00048-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4a2121cf22452b51edf1014787416cf7dcc49b5e2ed3cb0f05ab0854ad39b928
+size 11991649888

model-00051-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:06213bad5608691ebdfb3120bdd5e97c3ea7b33172c7acc3dabdd0833aea84ac
+size 11991649712

model-00055-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7a94b7e4e1678e93a7cedcf248696f09fe953830e19a91fe9c72dec21981fd11
+size 11991649912

model-00057-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3d0f34b310723b3e2b06b60f558d549b605c3d0e9e9136b0ec8f10934b46452c
+size 11991649592

model-00059-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cfd13d7805c618b3225a88829ae0d73baaa6d990628ac38e672c8fff4ebf3158
+size 11991649656

model-00060-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b9051c8e9075fb7513d507906aa1a2605f17958b7661f517a6177e5d2d03c9f1
+size 11991649776

model-00061-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4a9453527642feff53ecf6da299257eefb6d7391d34571299f80ba0c509b5646
+size 11991650040

model-00062-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9353c62bba04ee66475ed8a6b2975f25b2db465320bb463d7ce163ebd0c2ddff
+size 11991649448

model-00069-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5a5a0e61ff994bfbcca50e9b093e8784779980cb31f63cc6083a06898d80cabf
+size 11991649952

model-00075-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c1c5e088c5bd39b406783272fe68f4a035f5ab6ef08a641c0bc7ebdf175fcd85
+size 11991649552

model-00076-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ba453fcaeefc07648f3c0b2d5c9ca49a496bf5ee991cbb83908c4911513a7e90
+size 11991649920

model-00081-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d4592948ed4439b74fec01cecb87db7a702cd53b833bb0c8d3bd7def9e897bef
+size 11991649728

model-00082-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:36701e107683f6a9997a27f42078cf8987083e805101fff14dd365e77f0780c8
+size 11991649992

model-00089-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1d115167eff38babb55a86fefba2785d7096ab0d58830d3f498a1863d727e218
+size 11991649784

model-00093-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ae75e70ade2baea38aaf6ee98f9c8f5f946d549808f5610a63cba1347533e19d
+size 11991649768

model-00098-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:33c60f6a313ee2a67a5097c79fa9da50c00358024e61782494857c16584ff875
+size 11991649936

model-00103-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b373a20b0325a223a41f3cf959c322aca695d2bef2d431edfd347b3480f03f8b
+size 11991649944

model-00109-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:04a5ed1891f18ea8215457b69c360b1694ef924190c53304e0699d9724863307
+size 11991649688

model-00112-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:32e7ae965ef27ce70e8acc7de6ad2e6056803ebbba83e4c653e93d23b9969a2c
+size 11991649480

model-00128-of-00153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b6d0702bf14c25ea2e3a565174ffe02adb620b78e55054a353cbd2b1174731c8
+size 11991649512

model.safetensors.index.json ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3733f74fd90ed794e5d707105406b5e3fba5b169dfe8bddb501ca936fbfdb669
+size 15442225