Instructions to use jppaolim/v36_Naive with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jppaolim/v36_Naive with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="jppaolim/v36_Naive")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("jppaolim/v36_Naive") model = AutoModelForCausalLM.from_pretrained("jppaolim/v36_Naive") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use jppaolim/v36_Naive with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jppaolim/v36_Naive" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jppaolim/v36_Naive", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/jppaolim/v36_Naive
- SGLang
How to use jppaolim/v36_Naive with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "jppaolim/v36_Naive" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jppaolim/v36_Naive", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "jppaolim/v36_Naive" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jppaolim/v36_Naive", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use jppaolim/v36_Naive with Docker Model Runner:
docker model run hf.co/jppaolim/v36_Naive
Delete README.md
Browse files
README.md
DELETED
|
@@ -1,16 +0,0 @@
|
|
| 1 |
-
# Dummy model
|
| 2 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>Bad Breath. Arthur was at the beach. He was very thirsty. He didn't want to drink too much water. He went to the bathroom. Arthur went to the beach anyway.
|
| 3 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The Lost Dog. Arthur is going to the beach. Arthur gets scared. He runs out of breath. Arthur gets up and runs back to his house. Arthur goes home.
|
| 4 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The big day. Arthur was ready for school. He was going to the beach with his mom. He drove right to the beach. He went swimming with his mom. He had a great day at the beach.
|
| 5 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>Riley gets her phone. Riley is playing outside. She is playing with her phone. Her phone is on the ground. She grabs her phone. She goes to the beach.
|
| 6 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The new girl. Arthur was excited to go to the beach. He went to his favorite beach with his friends. His mom told him to relax. Arthur felt much better after he arrived. He is glad he went to the beach.
|
| 7 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The Dance. Arthur had been training for months. He decided he wanted to go to the beach. He bought a beach towel and some sunscreen. He spent the day playing in the sand. Arthur felt refreshed and ready for the big dance.
|
| 8 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The Beach. Arthur was going to the beach with his girlfriend. Arthur decided to take her out on a date. He went to the beach and had a great time. Arthur left the beach feeling very refreshed. Arthur was glad he went to the beach with his girlfriend.
|
| 9 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The dog fight. Arthur was walking home from school one day. He heard a dog barking outside. He looked over and saw a stray dog fighting. The dog had a collar on it and was trying to bite Arthur. Arthur's mother rushed him to the hospital.
|
| 10 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The New Computer. Arthur was a computer programmer. He had a new computer and wanted to get it running. He looked online for a cheap one and found one. He went to the computer store and bought it. He installed it and now he's happy with his new computer.
|
| 11 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>Tennis. Arthur loves tennis. He plays a lot of tennis. One day he decided to play tennis. He lost badly. Arthur is very sad about that day.
|
| 12 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The New Puppy. Arthur was excited to get his new puppy. He went to the pet store and picked out a puppy. He took the puppy home and named it Arthur. Arthur was so happy with his new puppy. Arthur is very happy that he got his new puppy.
|
| 13 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The Beach. Arthur was a young boy who loved the ocean. He went to the beach every day. He took his swimsuit off and went to the water. He swam in the water for hours. Arthur felt like he had made the right decision.
|
| 14 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The Beach. Arthur was going to the beach with his family. He packed his bags and headed out to the water. He got there at about an hour before the sun set. He had a great time swimming in the ocean. He felt like he was on the right path for the rest of his life.
|
| 15 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The Zoo Trip. Arthur was going on a trip to the zoo. He was excited to see all the animals. He got ready to leave for the day. He went to the zoo and saw many animals. He had a great time at the zoo.
|
| 16 |
-
<|Title|>Arthur goes to the beach. <|Step 1|>The Pool. Arthur went to the pool with his family. He was excited to go swimming. He got a towel and some water. He swam for an hour before going home. He was glad he went swimming.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|