Instructions to use ainth89/your_output_dir_zezze with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ainth89/your_output_dir_zezze with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ainth89/your_output_dir_zezze")

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("ainth89/your_output_dir_zezze")
model = AutoModelForMultimodalLM.from_pretrained("ainth89/your_output_dir_zezze")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ainth89/your_output_dir_zezze with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ainth89/your_output_dir_zezze"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ainth89/your_output_dir_zezze",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/ainth89/your_output_dir_zezze

SGLang

How to use ainth89/your_output_dir_zezze with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ainth89/your_output_dir_zezze" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ainth89/your_output_dir_zezze",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ainth89/your_output_dir_zezze" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ainth89/your_output_dir_zezze",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use ainth89/your_output_dir_zezze with Docker Model Runner:
```
docker model run hf.co/ainth89/your_output_dir_zezze
```

ainth89 commited on Sep 10, 2024

Commit

d93dc12

verified ·

1 Parent(s): 68a3119

End of training

Browse files

Files changed (6) hide show

README.md +3 -3
config.json +1 -1
model.safetensors +1 -1
runs/Sep10_15-25-08_5830fb298992/events.out.tfevents.1725981949.5830fb298992.2022.0 +3 -0
special_tokens_map.json +7 -1
training_args.bin +1 -1

README.md CHANGED Viewed

@@ -1,7 +1,7 @@
 ---
 library_name: transformers
 license: apache-2.0
-base_model: TinyLlama/TinyLlama_v1.1
 tags:
 - trl
 - sft
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 # your_output_dir_zezze
-This model is a fine-tuned version of [TinyLlama/TinyLlama_v1.1](https://huggingface.co/TinyLlama/TinyLlama_v1.1) on an unknown dataset.
 ## Model description
@@ -41,7 +41,7 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 1
 ### Training results

 ---
 library_name: transformers
 license: apache-2.0
+base_model: ainth89/your_output_dir_zezze
 tags:
 - trl
 - sft
 # your_output_dir_zezze
+This model is a fine-tuned version of [ainth89/your_output_dir_zezze](https://huggingface.co/ainth89/your_output_dir_zezze) on an unknown dataset.
 ## Model description
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
+- num_epochs: 4
 ### Training results

config.json CHANGED Viewed

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "TinyLlama/TinyLlama_v1.1",
   "architectures": [
     "LlamaForCausalLM"
   ],

 {
+  "_name_or_path": "ainth89/your_output_dir_zezze",
   "architectures": [
     "LlamaForCausalLM"
   ],

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9064917238c870b36ba9cc17a6a2f2ed1b75f31bdd7b27ed978016201b39f193
 size 4400216536

 version https://git-lfs.github.com/spec/v1
+oid sha256:6235aae1edf94b09ffd0e12c9268d727b9631033b7e5cd599b2cfec21eb6a0fe
 size 4400216536

runs/Sep10_15-25-08_5830fb298992/events.out.tfevents.1725981949.5830fb298992.2022.0 ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f6c7566f7cce4b7fe33caf72417140ec8cbfe36f0de565f7f26655eaa98a3f21
+size 5624

special_tokens_map.json CHANGED Viewed

@@ -13,7 +13,13 @@
     "rstrip": false,
     "single_word": false
   },
-  "pad_token": "</s>",
   "unk_token": {
     "content": "<unk>",
     "lstrip": false,

     "rstrip": false,
     "single_word": false
   },
+  "pad_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
   "unk_token": {
     "content": "<unk>",
     "lstrip": false,

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:695d3d2477557a0121a5add8ef7710d616bedfb400674ff6a43da6dbf5542085
 size 5432

 version https://git-lfs.github.com/spec/v1
+oid sha256:9f0258b6ba0b948f1b5ed2d66947be56033d649025c5ed9244f819380852e5dc
 size 5432