⚖️ JurisRoute — Qwen2 LoRa Fine-tuned
📌 Description
JurisRoute is a fine-tuned version of Qwen2-7B using LoRA (Low-Rank Adaptation) for legal and juridical question answering.
The model is specialized for:
- 🇲🇦 Moroccan law & jurisprudence
- Legal document understanding
- Juridical Q&A in French, Arabic, and English
🎯 Objective
The goal of JurisRoute is to provide an accessible AI assistant capable of answering legal questions based on Moroccan juridical texts, without requiring expensive cloud infrastructure.
🔧 Fine-tuning Process
Base Model
- Model: Qwen2-7B
- Method: LoRA (Low-Rank Adaptation)
- Format: Safetensors
LoRA Configuration
| Parameter | Value |
|---|---|
| Method | LoRA |
| Rank (r) | 16 |
| Alpha | 32 |
| Target modules | q_proj, v_proj |
| Dropout | 0.05 |
Training Setup
| Parameter | Value |
|---|---|
| Framework | Hugging Face PEFT |
| Precision | FP16 |
| Optimizer | AdamW |
| Dataset | Moroccan legal texts |
📊 Fine-tuning Process Diagram
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for ApyHTML19/JurisRoute-qwen2-LoRa
Base model
Qwen/Qwen2-7B