Text Generation
Transformers
Safetensors
llama
logic
argumentation
critical-thinking
argument-mapping
Generated from Trainer
trl
dpo
spin
conversational
text-generation-inference
Instructions to use DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN") model = AutoModelForMultimodalLM.from_pretrained("DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN
- SGLang
How to use DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN with Docker Model Runner:
docker model run hf.co/DebateLabKIT/Llama-3.3-Argunaut-1-70B-SPIN
Upload LlamaForCausalLM
Browse files- README.md +1 -0
- model-00001-of-00030.safetensors +1 -1
- model-00002-of-00030.safetensors +1 -1
- model-00003-of-00030.safetensors +1 -1
- model-00004-of-00030.safetensors +1 -1
- model-00005-of-00030.safetensors +1 -1
- model-00006-of-00030.safetensors +1 -1
- model-00007-of-00030.safetensors +1 -1
- model-00008-of-00030.safetensors +1 -1
- model-00009-of-00030.safetensors +1 -1
- model-00011-of-00030.safetensors +1 -1
- model-00012-of-00030.safetensors +1 -1
- model-00013-of-00030.safetensors +1 -1
- model-00014-of-00030.safetensors +1 -1
- model-00015-of-00030.safetensors +1 -1
- model-00016-of-00030.safetensors +1 -1
- model-00017-of-00030.safetensors +1 -1
- model-00018-of-00030.safetensors +1 -1
- model-00019-of-00030.safetensors +1 -1
- model-00020-of-00030.safetensors +1 -1
- model-00021-of-00030.safetensors +1 -1
- model-00022-of-00030.safetensors +1 -1
- model-00023-of-00030.safetensors +1 -1
- model-00024-of-00030.safetensors +1 -1
- model-00025-of-00030.safetensors +1 -1
- model-00026-of-00030.safetensors +1 -1
- model-00027-of-00030.safetensors +1 -1
- model-00028-of-00030.safetensors +1 -1
- model-00029-of-00030.safetensors +1 -1
- model-00030-of-00030.safetensors +1 -1
README.md
CHANGED
|
@@ -11,6 +11,7 @@ tags:
|
|
| 11 |
- selfplay_epoch_9
|
| 12 |
- selfplay_epoch_10
|
| 13 |
- selfplay_epoch_11
|
|
|
|
| 14 |
---
|
| 15 |
|
| 16 |
# Model Card for Model ID
|
|
|
|
| 11 |
- selfplay_epoch_9
|
| 12 |
- selfplay_epoch_10
|
| 13 |
- selfplay_epoch_11
|
| 14 |
+
- selfplay_epoch_12
|
| 15 |
---
|
| 16 |
|
| 17 |
# Model Card for Model ID
|
model-00001-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4584408808
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:25124e2a31110b069e9a85d5dd5ca3eb49c4fb0c42fcac7501604b1955c7a9a8
|
| 3 |
size 4584408808
|
model-00002-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167376
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:92695ff24d47edb10e278ec7f80d6733d99d15aed6f68a275c5d1e15b3282d1f
|
| 3 |
size 4664167376
|
model-00003-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4999711704
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90e7f2a59670ba4b2c1691a3e0581925cc6b39c104b33e2b78c88d2a14911062
|
| 3 |
size 4999711704
|
model-00004-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4966157032
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2eb678ba2ff3ca4b7d5ac19693e9b88d0260cbd7fff40509be23bc634ff32a44
|
| 3 |
size 4966157032
|
model-00005-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664134408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9bd736fde8036e7ec3c7fff8c5ca1350762bfd44aa2cbe967299093da31967db
|
| 3 |
size 4664134408
|
model-00006-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4bd46740fe5f43526d5ad690d100fb27ee8e0f1060dbb69ec0c2125442af8611
|
| 3 |
size 4664167408
|
model-00007-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8324e0352033d8945f4166e0ab8db510bb651475d1ce8779b80b29c0d2671af1
|
| 3 |
size 4664167408
|
model-00008-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4999711728
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:23479248c5062ab42648cf60a97188d88906ae104ebd55f4df1c4e3288552959
|
| 3 |
size 4999711728
|
model-00009-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4966157056
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e944fca51ce562d8f2ad0ef671ece5506c0330c2cbe88de107828bd287f8616
|
| 3 |
size 4966157056
|
model-00011-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1a656b43e716035ce903c2f64ba6ff801da7c2f607760df329c2d0207f0cad71
|
| 3 |
size 4664167408
|
model-00012-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f33ff2c17e8587253079a01b7b04355633731b5df9252b96b697240d284c1d73
|
| 3 |
size 4664167408
|
model-00013-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4999711728
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2606333e36166f576c39b976d44e60bfad2d50018c6a092fe280169a57bef461
|
| 3 |
size 4999711728
|
model-00014-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4966157056
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:67ae44f9cc02152a88c14da4a15f9ff6f2a615afe2ef40c11dd50b2dff12b91f
|
| 3 |
size 4966157056
|
model-00015-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664134408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:85258b340627c3e189c3fa73274e2755d06313ba20cea3b563b2dc3c282579c8
|
| 3 |
size 4664134408
|
model-00016-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:95b093d385768d627449d449cfc3b4e2c0aed3f941b562a9d3cb0cca75a7dd9a
|
| 3 |
size 4664167408
|
model-00017-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:89eaa61796be05c3142c776951efe70d6aceb16b4beaf9dba2bbe763b7f0981e
|
| 3 |
size 4664167408
|
model-00018-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4999711728
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aaa8a2d64206ac7d379333eb16e0c92521872e77a9c74420b1e003fe6982fb06
|
| 3 |
size 4999711728
|
model-00019-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4966157056
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b2052d6433bf388285465cebb2653fa8d8e5e2e888feb14d0ee87e3a158dc4bc
|
| 3 |
size 4966157056
|
model-00020-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664134408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6c530b1a3f50d7976e4682bd95362a624fb4093a4e8ecf0876f529871742d0c4
|
| 3 |
size 4664134408
|
model-00021-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:00976600b6774cb73aae0cd7c0a0176964be9899c12e7bfdf8da19411ecbaf51
|
| 3 |
size 4664167408
|
model-00022-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4658cb200170c5b62fd694f7ffd4a0cf6fdd0d3d2bd5bec348576eafa9a580a5
|
| 3 |
size 4664167408
|
model-00023-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4999711728
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2c3d8484820e773b467b29866643e99e51d587ecf80d327df5c8acdd2fe96c26
|
| 3 |
size 4999711728
|
model-00024-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4966157056
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b58ab692e5485cf872e5071a20ccb266e47f52ad3d516b26ef4a395b8f77bace
|
| 3 |
size 4966157056
|
model-00025-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664134408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc8b4e5d2adfde65b3c9e3393f758228f43a0874046433b38aa6e925ffbb58ff
|
| 3 |
size 4664134408
|
model-00026-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e03a6b55c245ee8b736161d2dfa1809ac5e7afd4e10c28db599419199623772e
|
| 3 |
size 4664167408
|
model-00027-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664167408
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6e2ac50a5b9af282d88d1d61b22200d08d507b1e02dda8601b99c140e1aa1ed6
|
| 3 |
size 4664167408
|
model-00028-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4999711728
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:70d70d92fe918e3186baf5ebccc15b13400ace9f8307d814c8c59307271624ba
|
| 3 |
size 4999711728
|
model-00029-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4966173536
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:09e09e90550af6071b102609d88c062e46c4a8b0dc8dfdfbc938122070d79812
|
| 3 |
size 4966173536
|
model-00030-of-00030.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2101346432
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:74ccb22037874e001c11840f88fefbcca1a9350a6516e5d72fb18e809df6eb4c
|
| 3 |
size 2101346432
|