Instructions to use baidu/ERNIE-4.5-0.3B-Base-PT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use baidu/ERNIE-4.5-0.3B-Base-PT with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="baidu/ERNIE-4.5-0.3B-Base-PT")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("baidu/ERNIE-4.5-0.3B-Base-PT")
model = AutoModelForCausalLM.from_pretrained("baidu/ERNIE-4.5-0.3B-Base-PT")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use baidu/ERNIE-4.5-0.3B-Base-PT with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "baidu/ERNIE-4.5-0.3B-Base-PT"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "baidu/ERNIE-4.5-0.3B-Base-PT",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/baidu/ERNIE-4.5-0.3B-Base-PT

SGLang

How to use baidu/ERNIE-4.5-0.3B-Base-PT with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "baidu/ERNIE-4.5-0.3B-Base-PT" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "baidu/ERNIE-4.5-0.3B-Base-PT",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "baidu/ERNIE-4.5-0.3B-Base-PT" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "baidu/ERNIE-4.5-0.3B-Base-PT",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use baidu/ERNIE-4.5-0.3B-Base-PT with Docker Model Runner:
```
docker model run hf.co/baidu/ERNIE-4.5-0.3B-Base-PT
```

ERNIE-4.5-0.3B-Base-PT

Commit History

version fix

8bf2f1f

AntonV HF Staff commited on Jul 22, 2025

readme

bc8712d

AntonV HF Staff commited on Jul 21, 2025

readme

7855fdd

AntonV HF Staff commited on Jul 21, 2025

remove remote

64ccae6

AntonV HF Staff commited on Jul 21, 2025

hf version

7ccc041

AntonV HF Staff commited on Jul 21, 2025

fix model

2159280
verified

hlfby06 commited on Jul 18, 2025

update tokenization decode

3b073eb
verified

hlfby06 commited on Jul 15, 2025

fix

e864775

liuyang164 commited on Jul 8, 2025

fix flash_attn

8215570

liuyang164 commited on Jul 8, 2025

fix tokenization

516a200

liuyang164 commited on Jul 8, 2025

Update README.md

5a782fb
verified

WYF3634076 commited on Jul 4, 2025

update README

3cb6182

liuyang164 commited on Jul 4, 2025

update README

5e2c2f0

liuyang164 commited on Jul 4, 2025

Update README.md (#2)

647d338
verified

jzhang533

sunzhongkai588 commited on Jul 3, 2025

update tokenization

6b21614

liuyang164 commited on Jul 3, 2025

fix tokenization

fdacccb

liuyang164 commited on Jun 30, 2025

Update README.md

f9f0f4a
verified

liaojc commited on Jun 30, 2025

fix tokenization

64fcf63

liuyang164 commited on Jun 30, 2025

fix tokenization

82d63be

liuyang164 commited on Jun 30, 2025

Update README.md

ef7d71b
verified

SFLY5 commited on Jun 30, 2025

Update README.md

f81bf2e
verified

hlfby06 commited on Jun 29, 2025

Update README.md

ad2b408
verified

hlfby06 commited on Jun 29, 2025

Update README.md

7c74f99
verified

hlfby06 commited on Jun 29, 2025

Upload folder using huggingface_hub

b307513
verified

hlfby06 commited on Jun 28, 2025

initial commit

ce705b0
verified

hlfby06 commited on Jun 28, 2025

Commit History

version fix 8bf2f1f

readme bc8712d

readme 7855fdd

remove remote 64ccae6

hf version 7ccc041

fix model 2159280 verified

update tokenization decode 3b073eb verified

fix e864775

fix flash_attn 8215570

fix tokenization 516a200

Update README.md 5a782fb verified

update README 3cb6182

update README 5e2c2f0

Update README.md (#2) 647d338 verified

update tokenization 6b21614

fix tokenization fdacccb

Update README.md f9f0f4a verified

fix tokenization 64fcf63

fix tokenization 82d63be

Update README.md ef7d71b verified

Update README.md f81bf2e verified

Update README.md ad2b408 verified

Update README.md 7c74f99 verified

Upload folder using huggingface_hub b307513 verified

initial commit ce705b0 verified

version fix

8bf2f1f

readme

bc8712d

readme

7855fdd

remove remote

64ccae6

hf version

7ccc041

fix model

2159280
verified

update tokenization decode

3b073eb
verified

fix

e864775

fix flash_attn

8215570

fix tokenization

516a200

Update README.md

5a782fb
verified

update README

3cb6182

update README

5e2c2f0

Update README.md (#2)

647d338
verified

update tokenization

6b21614

fix tokenization

fdacccb

Update README.md

f9f0f4a
verified

fix tokenization

64fcf63

fix tokenization

82d63be

Update README.md

ef7d71b
verified

Update README.md

f81bf2e
verified

Update README.md

ad2b408
verified

Update README.md

7c74f99
verified

Upload folder using huggingface_hub

b307513
verified

initial commit

ce705b0
verified