Instructions to use overthelex/qwen2.5-0.5b-edrsr-legal-uk with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use overthelex/qwen2.5-0.5b-edrsr-legal-uk with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="overthelex/qwen2.5-0.5b-edrsr-legal-uk")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("overthelex/qwen2.5-0.5b-edrsr-legal-uk")
model = AutoModelForCausalLM.from_pretrained("overthelex/qwen2.5-0.5b-edrsr-legal-uk", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use overthelex/qwen2.5-0.5b-edrsr-legal-uk with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "overthelex/qwen2.5-0.5b-edrsr-legal-uk"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "overthelex/qwen2.5-0.5b-edrsr-legal-uk",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/overthelex/qwen2.5-0.5b-edrsr-legal-uk

SGLang

How to use overthelex/qwen2.5-0.5b-edrsr-legal-uk with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "overthelex/qwen2.5-0.5b-edrsr-legal-uk" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "overthelex/qwen2.5-0.5b-edrsr-legal-uk",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "overthelex/qwen2.5-0.5b-edrsr-legal-uk" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "overthelex/qwen2.5-0.5b-edrsr-legal-uk",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use overthelex/qwen2.5-0.5b-edrsr-legal-uk with Docker Model Runner:
```
docker model run hf.co/overthelex/qwen2.5-0.5b-edrsr-legal-uk
```

Qwen2.5-0.5B-EDRSR-Legal-UK

Ukrainian legal domain model obtained by continued pretraining (CPT) of Qwen2.5-0.5B on the EDRSR corpus of Ukrainian court decisions.

Part of a scaling experiment (0.5B / 1.5B / 3B) for the PhD dissertation at Glushkov Institute of Cybernetics, NAS of Ukraine.

Training Data

Corpus: Unified State Register of Court Decisions of Ukraine (EDRSR)
Documents: 33.9M court decisions (after dedup + quality filtering from 38.5M)
Tokens: 161.4B tokens (Qwen2 BPE tokenizer, fertility = 0.515 for Ukrainian legal text)
Sequence length: 8,192 tokens
Shards: 1,233 pre-packaged numpy shards

Training Details

Hardware: 8x NVIDIA H100 SXM 80GB (NVIDIA Innovation Lab via Brev)
Framework: HuggingFace Trainer + DeepSpeed ZeRO-3
Precision: bfloat16
Global batch size: 128 sequences (micro_batch=4, grad_accum=4, 8 GPUs)
Tokens per step: 1.05M
Total steps: 9,536 (10B tokens processed)
Learning rate: 2e-4, cosine schedule, 300-step linear warmup
Training time: 8.4 hours
Throughput: 262K tokens/sec, 3.2 sec/step

Results

Metric	Value
Initial loss (step 10)	1.5254
Final loss (step 9,536)	0.2633
Loss reduction	-83%
Train loss (avg)	0.3117
Total FLOPs	2.65e18

Intended Use

This is a base model (not instruction-tuned). It is intended for:

Research on domain adaptation of LLMs for low-resource legal languages
Downstream fine-tuning for Ukrainian legal NLP tasks
Scaling law analysis of continued pretraining
Perplexity evaluation on Ukrainian legal text

Limitations

Not instruction-tuned; will not follow instructions or chat
Trained on Ukrainian court decisions only; may not generalize to other legal systems
Small model (0.5B) -- limited reasoning capacity compared to larger variants