📌 Description
JurisRoute is a fine-tuned version of Qwen2-7B
using LoRA (Low-Rank Adaptation) for legal and juridical question answering.
The model is specialized for:
- 🇲🇦 Moroccan law & jurisprudence
- Legal document understanding
- Juridical Q&A in French, Arabic, and English
🎯 Objective
The goal of JurisRoute is to provide an accessible AI assistant capable of
answering legal questions based on Moroccan juridical texts, without requiring
expensive cloud infrastructure.
🔧 Fine-tuning Process
Base Model
- Model: Qwen2-7B
- Method: LoRA (Low-Rank Adaptation)
- Format: Safetensors
LoRA Configuration
Table with columns: Parameter, Value| Parameter | Value |
|---|
| Method | LoRA |
| Rank (r) | 16 |
| Alpha | 32 |
| Target modules | q_proj, v_proj |
| Dropout | 0.05 |
Training Setup
Table with columns: Parameter, Value| Parameter | Value |
|---|
| Framework | Hugging Face PEFT |
| Precision | FP16 |
| Optimizer | AdamW |
| Dataset | Moroccan legal texts |
📊 Fine-tuning Process Diagram

