Instructions to use ibm-granite/granite-4.0-h-1b-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ibm-granite/granite-4.0-h-1b-base with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ibm-granite/granite-4.0-h-1b-base")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ibm-granite/granite-4.0-h-1b-base")
model = AutoModelForCausalLM.from_pretrained("ibm-granite/granite-4.0-h-1b-base")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ibm-granite/granite-4.0-h-1b-base with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ibm-granite/granite-4.0-h-1b-base"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ibm-granite/granite-4.0-h-1b-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/ibm-granite/granite-4.0-h-1b-base

SGLang

How to use ibm-granite/granite-4.0-h-1b-base with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ibm-granite/granite-4.0-h-1b-base" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ibm-granite/granite-4.0-h-1b-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ibm-granite/granite-4.0-h-1b-base" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ibm-granite/granite-4.0-h-1b-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use ibm-granite/granite-4.0-h-1b-base with Docker Model Runner:
```
docker model run hf.co/ibm-granite/granite-4.0-h-1b-base
```

granite-4.0-h-1b-base / model.sig

ranarag

model upload

898de0f verified 9 months ago

Raw

History Blame

8.03 kB

{"mediaType": "application/vnd.dev.sigstore.bundle.v0.3+json", "verificationMaterial": {"certificate": {"rawBytes": "MIIC5DCCAmugAwIBAgIUQkVqllxJBjOHdzy12eDduzcQFcAwCgYIKoZIzj0EAwMwNzEVMBMGA1UEChMMc2lnc3RvcmUuZGV2MR4wHAYDVQQDExVzaWdzdG9yZS1pbnRlcm1lZGlhdGUwHhcNMjUxMDEzMTg0MjQyWhcNMjUxMDEzMTg1MjQyWjAAMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAECgpEOyPshRbIk2eyoIwn8nHiY4WiNFrzguxwKtaWxWt1Bowt2N08Q9dwTssVZ52o1IPY/zZ18v22FqH4AZhY0KOCAYowggGGMA4GA1UdDwEB/wQEAwIHgDATBgNVHSUEDDAKBggrBgEFBQcDAzAdBgNVHQ4EFgQUp4dofe8GkS/aXctg0MPqaLd4GfowHwYDVR0jBBgwFoAU39Ppz1YkEZb5qNjpKFWixi4YZD8wJAYDVR0RAQH/BBowGIEWR3Jhbml0ZS12ZXJpZnlAaWJtLmNvbTA0BgorBgEEAYO/MAEBBCZodHRwczovL3NpZ3N0b3JlLnZlcmlmeS5pYm0uY29tL29hdXRoMjA2BgorBgEEAYO/MAEIBCgMJmh0dHBzOi8vc2lnc3RvcmUudmVyaWZ5LmlibS5jb20vb2F1dGgyMIGKBgorBgEEAdZ5AgQCBHwEegB4AHYA3T0wasbHETJjGR4cmWc3AqJKXrjePK3/h4pygC8p7o4AAAGZ3uHIoAAABAMARzBFAiEA4YH/vNm3/Rgl0yQf+s1fZqVhSD2W3e+hgAHURAsUBCUCIHek5BdJdaNTWOb+NxtRNCzynKUJnENUmQH2Ls4b6aI7MAoGCCqGSM49BAMDA2cAMGQCMHTL3ZRTAYJLmBQ4df8xzDpSOP6MNuIcgkUp/XXUxi+HYOBujOcPR+R3kMlOP1iSqQIwBYa7qAPsmpCfKMZ5EAOuXQms83BFtBBQwrSr8adqbeieGEz/BgcB2JnUADxxWgKh"}, "tlogEntries": [{"logIndex": "603504649", "logId": {"keyId": "wNI9atQGlz+VWfO6LRygH4QUfY/8W4RFwiT5i5WRgB0="}, "kindVersion": {"kind": "dsse", "version": "0.0.1"}, "integratedTime": "1760380963", "inclusionPromise": {"signedEntryTimestamp": "MEQCIC8xpuzRWLQ7kT6NXXCGUyKHeyIAQ4jKhCiYn4qjdIQpAiAHoy9IYNNRwbyCccehY9o/3rfDzUV/8LIpzpIPSbCVIw=="}, "inclusionProof": {"logIndex": "481600387", "rootHash": "lTGr+twbbBh9ViCFrz6wcDQvwGKELs/hHKf7KJo79mM=", "treeSize": "481600404", "hashes": ["QPVPDsnatYWtX/Gx1usht39hJLmOi0Y4st+w9YSRIlo=", "OSsqpMReipwel+M5jjEoflFKau6W/lyjgh4a//hGqSw=", "BSZZgNp0Ax6+PvwADCFmk99XPAz1D3L6a+Y5SRV+PJk=", "BTWucgofkvqO4Ac0Vwj2+wEZ9OXSERpE+hl8vWbiazk=", "/P0WILPAbChsxvsivwfGKCBB2YIVYNTJknAqrqqPxsA=", "svO2sWJOPf3bWm7ck9lZXwH41ZjbZvY3g7pKaqykvtE=", "+HHYIB9ZP1j2MOduxAbEQ6LldnZ4beYlNmWeQLd+QiE=", "W/gsIA300minUIfXN6bxIfiLLvumIH2DLHJe3LLWVzg=", "25WnhiU4SQLa7cMSj2ET1pHP+ib6JhFigEAYYSX25iA=", "UJ08QthmwsUT/Q/h3RP5fnBYtpN7wcHIqKzW/eI8b9w=", "kiTR6jWhoD43tdpMDeSLtBFM2ulJhNy8oGI9kEc+4Sc=", "lEiujNeXDeP41X0ppw2Qbrc5U9ylRyNUvlpzRwDCHbA=", "rrf+/cU3hhyHigVzum86kiBbbWdsquKHDGUoR3bCRdY=", "V5lOdefY1WOOt4iQp7tZoyj1beBDVi24KsEMcgsqZds=", "2Wv4GiithwNukRKV06clevnQQYCzXmSS/+/OJtXgsXQ=", "1mfy94KpcItqshH9+gwqV6jccupcaMpVsF28New8zDY=", "vS7O4ozHIQZJWBiov+mkpI27GE8zAmVCEkRcP3NDyNE="], "checkpoint": {"envelope": "rekor.sigstore.dev - 1193050959916656506\n481600404\nlTGr+twbbBh9ViCFrz6wcDQvwGKELs/hHKf7KJo79mM=\n\n\u2014 rekor.sigstore.dev wNI9ajBGAiEAixpY/dh6reJUmQdW5UNNhyLqn6uqoIWTnPtVDkN6DeMCIQD0XOkuT0Mk14nrSfctImu0qPf4GPea/qgpk6reCb3bLA==\n"}}, "canonicalizedBody": "eyJhcGlWZXJzaW9uIjoiMC4wLjEiLCJraW5kIjoiZHNzZSIsInNwZWMiOnsiZW52ZWxvcGVIYXNoIjp7ImFsZ29yaXRobSI6InNoYTI1NiIsInZhbHVlIjoiZDRhNDgxODRjMGFhOGM2NjUzOTkwNzA3YWE4YWJkYjU0YzQ0NTJlODUwNjI0MjYyZDJjMTYwZmJhZWYyYWM5NiJ9LCJwYXlsb2FkSGFzaCI6eyJhbGdvcml0aG0iOiJzaGEyNTYiLCJ2YWx1ZSI6IjQ1NjFhMGUyMTNiNjFjODIxMWFhOGQzZTljZjI5MTExNGM1MTgzMjk0NDUzM2E3MTA0NjY0NGU3NGIyOTg2ZmUifSwic2lnbmF0dXJlcyI6W3sic2lnbmF0dXJlIjoiTUVZQ0lRRGM1TDBRTThLakZqK0VkazdmeE5yYjZ1bGIvK2RDWC94ZEV4U2V0ZkZkU1FJaEFNaDVpaEhJRk1seU43eUQwNXNlazNzbWNhUExsaVFxVlVscnpoNlliVU1zIiwidmVyaWZpZXIiOiJMUzB0TFMxQ1JVZEpUaUJEUlZKVVNVWkpRMEZVUlMwdExTMHRDazFKU1VNMVJFTkRRVzExWjBGM1NVSkJaMGxWVVd0V2NXeHNlRXBDYWs5SVpIcDVNVEpsUkdSMWVtTlJSbU5CZDBObldVbExiMXBKZW1vd1JVRjNUWGNLVG5wRlZrMUNUVWRCTVZWRlEyaE5UV015Ykc1ak0xSjJZMjFWZFZwSFZqSk5ValIzU0VGWlJGWlJVVVJGZUZaNllWZGtlbVJIT1hsYVV6RndZbTVTYkFwamJURnNXa2RzYUdSSFZYZElhR05PVFdwVmVFMUVSWHBOVkdjd1RXcFJlVmRvWTA1TmFsVjRUVVJGZWsxVVp6Rk5hbEY1VjJwQlFVMUdhM2RGZDFsSUNrdHZXa2w2YWpCRFFWRlpTVXR2V2tsNmFqQkVRVkZqUkZGblFVVkRaM0JGVDNsUWMyaFNZa2xyTW1WNWIwbDNiamh1U0dsWk5GZHBUa1p5ZW1kMWVIY0tTM1JoVjNoWGRERkNiM2QwTWs0d09GRTVaSGRVYzNOV1dqVXliekZKVUZrdmVsb3hPSFl5TWtaeFNEUkJXbWhaTUV0UFEwRlpiM2RuWjBkSFRVRTBSd3BCTVZWa1JIZEZRaTkzVVVWQmQwbElaMFJCVkVKblRsWklVMVZGUkVSQlMwSm5aM0pDWjBWR1FsRmpSRUY2UVdSQ1owNVdTRkUwUlVablVWVndOR1J2Q21abE9FZHJVeTloV0dOMFp6Qk5VSEZoVEdRMFIyWnZkMGgzV1VSV1VqQnFRa0puZDBadlFWVXpPVkJ3ZWpGWmEwVmFZalZ4VG1wd1MwWlhhWGhwTkZrS1drUTRkMHBCV1VSV1VqQlNRVkZJTDBKQ2IzZEhTVVZYVWpOS2FHSnRiREJhVXpFeVdsaEtjRnB1YkVGaFYwcDBURzFPZG1KVVFUQkNaMjl5UW1kRlJRcEJXVTh2VFVGRlFrSkRXbTlrU0ZKM1kzcHZka3d6VG5CYU0wNHdZak5LYkV4dVdteGpiV3h0WlZNMWNGbHRNSFZaTWpsMFRESTVhR1JZVW05TmFrRXlDa0puYjNKQ1owVkZRVmxQTDAxQlJVbENRMmROU20xb01HUklRbnBQYVRoMll6SnNibU16VW5aamJWVjFaRzFXZVdGWFdqVk1iV3hwWWxNMWFtSXlNSFlLWWpKR01XUkhaM2xOU1VkTFFtZHZja0puUlVWQlpGbzFRV2RSUTBKSWQwVmxaMEkwUVVoWlFUTlVNSGRoYzJKSVJWUktha2RTTkdOdFYyTXpRWEZLU3dwWWNtcGxVRXN6TDJnMGNIbG5Remh3TjI4MFFVRkJSMW96ZFVoSmIwRkJRVUpCVFVGU2VrSkdRV2xGUVRSWlNDOTJUbTB6TDFKbmJEQjVVV1lyY3pGbUNscHhWbWhUUkRKWE0yVXJhR2RCU0ZWU1FYTlZRa05WUTBsSVpXczFRbVJLWkdGT1ZGZFBZaXRPZUhSU1RrTjZlVzVMVlVwdVJVNVZiVkZJTWt4ek5HSUtObUZKTjAxQmIwZERRM0ZIVTAwME9VSkJUVVJCTW1OQlRVZFJRMDFJVkV3eldsSlVRVmxLVEcxQ1VUUmtaamg0ZWtSd1UwOVFOazFPZFVsaloydFZjQW92V0ZoVmVHa3JTRmxQUW5WcVQyTlFVaXRTTTJ0TmJFOVFNV2xUY1ZGSmQwSlpZVGR4UVZCemJYQkRaa3ROV2pWRlFVOTFXRkZ0Y3pnelFrWjBRa0pSQ25keVUzSTRZV1J4WW1WcFpVZEZlaTlDWjJOQ01rcHVWVUZFZUhoWFowdG9DaTB0TFMwdFJVNUVJRU5GVWxSSlJrbERRVlJGTFMwdExTMEsifV19fQ=="}], "timestampVerificationData": {}}, "dsseEnvelope": {"payload": "ewogICJfdHlwZSI6ICJodHRwczovL2luLXRvdG8uaW8vU3RhdGVtZW50L3YxIiwKICAic3ViamVjdCI6IFsKICAgIHsKICAgICAgIm5hbWUiOiAiZ3Jhbml0ZS00LjAtaC1uYW5vLTFiLWJhc2UiLAogICAgICAiZGlnZXN0IjogewogICAgICAgICJzaGEyNTYiOiAiYmRhYmU3NjMwYmU0ZjE1Y2UyY2QyZTkxZTIxOTE1YzNiMzkxMmZlMDVjM2Y0ZGNhMWVmMDVhYWM5MzRiZWRkZiIKICAgICAgfQogICAgfQogIF0sCiAgInByZWRpY2F0ZVR5cGUiOiAiaHR0cHM6Ly9tb2RlbF9zaWduaW5nL3NpZ25hdHVyZS92MS4wIiwKICAicHJlZGljYXRlIjogewogICAgInJlc291cmNlcyI6IFsKICAgICAgewogICAgICAgICJhbGdvcml0aG0iOiAic2hhMjU2IiwKICAgICAgICAibmFtZSI6ICJjb25maWcuanNvbiIsCiAgICAgICAgImRpZ2VzdCI6ICJhYWZiZGFiZjliMGZmMThhYjE4ZTZkMjJiODY3YjFiYTAwNjMwNWZkNjY2YThkOWY1NzlkZTdjNGE5OGNhMGI4IgogICAgICB9LAogICAgICB7CiAgICAgICAgImFsZ29yaXRobSI6ICJzaGEyNTYiLAogICAgICAgICJuYW1lIjogImdlbmVyYXRpb25fY29uZmlnLmpzb24iLAogICAgICAgICJkaWdlc3QiOiAiN2MwNGNiOWQyYmE3NzFmNzUyOGZiYTVhNzEwNDk5OWNkYWY3NTY2ZDAyYjVmYmQ1ODQ3MjgyOWY2MjcxNjE3NyIKICAgICAgfSwKICAgICAgewogICAgICAgICJhbGdvcml0aG0iOiAic2hhMjU2IiwKICAgICAgICAibmFtZSI6ICJtZXJnZXMudHh0IiwKICAgICAgICAiZGlnZXN0IjogImI2ZmU0MjRlMzM0OTAzZjdmYjg0ZDNhMTA2ZDk3MzA0NTVmNDc0NGI5ZmUzYzIxZWUxMzZkOTdhMDBlNzI1MDIiCiAgICAgIH0sCiAgICAgIHsKICAgICAgICAiYWxnb3JpdGhtIjogInNoYTI1NiIsCiAgICAgICAgIm5hbWUiOiAibW9kZWwuc2FmZXRlbnNvcnMiLAogICAgICAgICJkaWdlc3QiOiAiOGU4OGJmZTY0MmFmOGNlN2E3MTg3MWZjYzVkMzMxMzBhYmVjMGM2M2JmMjEzN2NhOWE3N2UyMjE5MjYyZWQyOCIKICAgICAgfSwKICAgICAgewogICAgICAgICJhbGdvcml0aG0iOiAic2hhMjU2IiwKICAgICAgICAibmFtZSI6ICJtb2RlbC5zYWZldGVuc29ycy5pbmRleC5qc29uIiwKICAgICAgICAiZGlnZXN0IjogIjI0ZjE2MWFmMDRjZDY3YmY0ZTcwZjg4N2JmNWJlYjUzNzY3MmEwODYyMjkzNzI2YWVlMGFmMjI0YjhkYmEwYmYiCiAgICAgIH0sCiAgICAgIHsKICAgICAgICAiYWxnb3JpdGhtIjogInNoYTI1NiIsCiAgICAgICAgIm5hbWUiOiAic3BlY2lhbF90b2tlbnNfbWFwLmpzb24iLAogICAgICAgICJkaWdlc3QiOiAiYzA4Njc2YzQ5ZmQ3OTY5YTMxMzBmNzJiZTZkNGJmMzRkYTY2YWE0ODRhNmUyMWRmZmUzNTk4OTNhMWJkNWYyZSIKICAgICAgfSwKICAgICAgewogICAgICAgICJhbGdvcml0aG0iOiAic2hhMjU2IiwKICAgICAgICAibmFtZSI6ICJ0b2tlbml6ZXIuanNvbiIsCiAgICAgICAgImRpZ2VzdCI6ICI2NDUwZWNmZTc1MzE0MGVmMDEwMmQxNjkzNThmMGQ1YmM3YjViNTZhOGMyYTU0MTk3ODhjZTFhMWZkNGU3MzY3IgogICAgICB9LAogICAgICB7CiAgICAgICAgImFsZ29yaXRobSI6ICJzaGEyNTYiLAogICAgICAgICJuYW1lIjogInRva2VuaXplcl9jb25maWcuanNvbiIsCiAgICAgICAgImRpZ2VzdCI6ICJiN2NlNDFjYzJjNTNkMmUyYjE4YWVhMzc0NDNhMGMxOWM5MDM3YTQ4YTMxODEyMWQxNWIxZWMyNzVkN2YxZGU0IgogICAgICB9LAogICAgICB7CiAgICAgICAgImFsZ29yaXRobSI6ICJzaGEyNTYiLAogICAgICAgICJuYW1lIjogInZvY2FiLmpzb24iLAogICAgICAgICJkaWdlc3QiOiAiOGFmNzEwNzZkZThiMGI2MjZlZWQwZjRjOTg0ZmFmMGE3YzA2MjQ3OTE2NGIyYTMxMzA4YTk0ODUyNGQ0ZjY5YyIKICAgICAgfQogICAgXSwKICAgICJzZXJpYWxpemF0aW9uIjogewogICAgICAibWV0aG9kIjogImZpbGVzIiwKICAgICAgImFsbG93X3N5bWxpbmtzIjogZmFsc2UsCiAgICAgICJoYXNoX3R5cGUiOiAic2hhMjU2IgogICAgfQogIH0KfQ==", "payloadType": "application/vnd.in-toto+json", "signatures": [{"sig": "MEYCIQDc5L0QM8KjFj+Edk7fxNrb6ulb/+dCX/xdExSetfFdSQIhAMh5ihHIFMlyN7yD05sek3smcaPLliQqVUlrzh6YbUMs"}]}}