Instructions to use nex-agi/Nex-N2-mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use nex-agi/Nex-N2-mini with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="nex-agi/Nex-N2-mini")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("nex-agi/Nex-N2-mini")
model = AutoModelForMultimodalLM.from_pretrained("nex-agi/Nex-N2-mini")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use nex-agi/Nex-N2-mini with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "nex-agi/Nex-N2-mini"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2-mini",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/nex-agi/Nex-N2-mini

SGLang

How to use nex-agi/Nex-N2-mini with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "nex-agi/Nex-N2-mini" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2-mini",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "nex-agi/Nex-N2-mini" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2-mini",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use nex-agi/Nex-N2-mini with Docker Model Runner:
```
docker model run hf.co/nex-agi/Nex-N2-mini
```

Nex-N2-mini

Commit History

Update README.md

ca218dc
verified

guoteng commited on Jun 11

Update README.md

ea3eb3a
verified

guoteng commited on Jun 8

Update README.md

dfe6a21
verified

guoteng commited on Jun 8

Update README.md

44890e6
verified

guoteng commited on Jun 8

Update README.md

fa13dea
verified

Shuo Zhang commited on Jun 4

update readme

271699a

“wangguoteng” commited on Jun 4

Delete figures

cff13d7
verified

guoteng commited on Jun 4

Create figures/

ad9be80
verified

guoteng commited on Jun 4

Upload folder using huggingface_hub

66ea4b4
verified

guoteng commited on Jun 4

initial commit

1719e27
verified

guoteng commited on Jun 4

Commit History

Update README.md ca218dc verified

Update README.md ea3eb3a verified

Update README.md dfe6a21 verified

Update README.md 44890e6 verified

Update README.md fa13dea verified

update readme 271699a

Delete figures cff13d7 verified

Create figures/ ad9be80 verified

Upload folder using huggingface_hub 66ea4b4 verified

initial commit 1719e27 verified

Update README.md

ca218dc
verified

Update README.md

ea3eb3a
verified

Update README.md

dfe6a21
verified

Update README.md

44890e6
verified

Update README.md

fa13dea
verified

update readme

271699a

Delete figures

cff13d7
verified

Create figures/

ad9be80
verified

Upload folder using huggingface_hub

66ea4b4
verified

initial commit

1719e27
verified