Instructions to use NLPnorth/snakmodel-7b-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use NLPnorth/snakmodel-7b-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="NLPnorth/snakmodel-7b-base")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("NLPnorth/snakmodel-7b-base") model = AutoModelForCausalLM.from_pretrained("NLPnorth/snakmodel-7b-base") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use NLPnorth/snakmodel-7b-base with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "NLPnorth/snakmodel-7b-base" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "NLPnorth/snakmodel-7b-base", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/NLPnorth/snakmodel-7b-base
- SGLang
How to use NLPnorth/snakmodel-7b-base with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "NLPnorth/snakmodel-7b-base" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "NLPnorth/snakmodel-7b-base", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "NLPnorth/snakmodel-7b-base" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "NLPnorth/snakmodel-7b-base", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use NLPnorth/snakmodel-7b-base with Docker Model Runner:
docker model run hf.co/NLPnorth/snakmodel-7b-base
Commit History
Upload tokenizer.json with huggingface_hub ddc106b verified
Delete added_tokens.json cea4d9e verified
Upload tokenizer_config.json with huggingface_hub 4d895e5 verified
Upload tokenizer_config.json with huggingface_hub a919659 verified
Upload special_tokens_map.json with huggingface_hub c078cb5 verified
Delete .locks 75887fa verified
Delete models--NLPnorth--snakmodel-7b-base 6fa81bc verified
Upload .locks/models--NLPnorth--snakmodel-7b-base/4c8988d40c2efb718744eefa7d4d915e17b40df7.lock with huggingface_hub 9959046 verified
Upload .locks/models--NLPnorth--snakmodel-7b-base/a6344aac8c09253b3b630fb776ae94478aa0275b.lock with huggingface_hub 9d130ce verified
Upload models--NLPnorth--snakmodel-7b-base/refs/main with huggingface_hub 0809125 verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer_config.json with huggingface_hub 15fb22c verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer.model with huggingface_hub 2b1effb verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer.json with huggingface_hub 0cb737d verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/special_tokens_map.json with huggingface_hub 9369917 verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/snakmodel-base.png with huggingface_hub 118e6f1 verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/model.safetensors.index.json with huggingface_hub 0df0db0 verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/generation_config.json with huggingface_hub c639d21 verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/config.json with huggingface_hub 3330e37 verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/README.md with huggingface_hub 480c27a verified
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/.gitattributes with huggingface_hub bbc6f25 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/04a6b76c7b984884db39812a5ab72a8adc931a89 with huggingface_hub d7c21a2 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347 with huggingface_hub 4e35e58 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/86fe1a5aa6953e93b0b2020609b0a52c11621259 with huggingface_hub d4f5953 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/1e59223bfb9c3e9c479515876e9e5d164924ecaa with huggingface_hub 0ef1a23 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/814e1426a83b0eed37b690ab766e7535403e53bf with huggingface_hub 9a91132 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/13674e51e613232b3becd7046ec62b76392c976e with huggingface_hub 6c264d2 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/589fbcab306e58ba6d65e7dde03c89eb03ab6595 with huggingface_hub bd0affb verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/1f293b23113f1f3a34183cf34fd0be781156fb20 with huggingface_hub d15f2e3 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/48482c1623390e7ba8be812c489d663cc138d0b1 with huggingface_hub 410793f verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/4c8988d40c2efb718744eefa7d4d915e17b40df7 with huggingface_hub 838bdc1 verified
Upload models--NLPnorth--snakmodel-7b-base/blobs/a6344aac8c09253b3b630fb776ae94478aa0275b with huggingface_hub 321964c verified
uploaded final SnakModel-7B (base) model a8035fc verified
uploaded final SnakModel-7B (base) tokenizer 581063d verified
added library to metadata 8fcecee verified
uploaded final SnakModel-7B (base) model 7e4ed68 verified
uploaded final SnakModel-7B (base) tokenizer bbc3a52 verified
uploaded final SnakModel-7B (base) model aff6e00 verified
uploaded final SnakModel-7B (base) tokenizer 3e20795 verified
uploaded final SnakModel-7B (base) model 1612e57 verified
uploaded final SnakModel-7B (base) tokenizer 7f9ccd8 verified
uploaded final SnakModel-7B (base) model 0ebf7e1 verified
uploaded final SnakModel-7B (base) tokenizer 5e0188b verified
uploaded final SnakModel-7B (base) model 1198e84 verified
uploaded final SnakModel-7B (base) tokenizer 8b7d5a1 verified
uploaded final SnakModel-7B (base) model 1354e4f verified
uploaded final SnakModel-7B (base) tokenizer 267086f verified
added initial model card f87f301
Max Müller-Eberstein commited on