---
language:
- fr
- ar
- en
license: apache-2.0
base_model: Qwen/Qwen2-7B
tags:
- legal
- lora
- finetuned
- qwen2
- jurisprudence
- safetensors
---

# ⚖️ JurisRoute — Qwen2 LoRa Fine-tuned

## 📌 Description

**JurisRoute** is a fine-tuned version of [Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) 
using **LoRA (Low-Rank Adaptation)** for legal and juridical question answering.

The model is specialized for:
- 🇲🇦 Moroccan law & jurisprudence
- Legal document understanding
- Juridical Q&A in French, Arabic, and English

---

## 🎯 Objective

The goal of JurisRoute is to provide an accessible AI assistant capable of 
answering legal questions based on Moroccan juridical texts, without requiring 
expensive cloud infrastructure.

---

## 🔧 Fine-tuning Process

### Base Model
- **Model**: Qwen2-7B
- **Method**: LoRA (Low-Rank Adaptation)
- **Format**: Safetensors

### LoRA Configuration
| Parameter | Value |
|---|---|
| Method | LoRA |
| Rank (r) | 16 |
| Alpha | 32 |
| Target modules | q_proj, v_proj |
| Dropout | 0.05 |

### Training Setup
| Parameter | Value |
|---|---|
| Framework | Hugging Face PEFT |
| Precision | FP16 |
| Optimizer | AdamW |
| Dataset | Moroccan legal texts |

---

## 📊 Fine-tuning Process Diagram

![Capture d'écran 2026-03-17 232753](https://cdn-uploads.huggingface.co/production/uploads/69b8999e75f123eb8e7e6776/HJCLbOT4kS-yY_sC-f70P.png)

![Capture d'écran 2026-03-17 232759](https://cdn-uploads.huggingface.co/production/uploads/69b8999e75f123eb8e7e6776/t3hE8Esaa_8BogITG5rg4.png)