Base Model
- Model:
unsloth/Qwen2.5-3B-Instruct
- Fine-tuning Method: LoRA (PEFT)
- Framework: Unsloth + TRL
Task
The adapter is trained to generate ministry-style English examination questions, including:
- Grammar
- Vocabulary
- Unit-based questions
- Topic-based questions
The generated output follows a structured JSON format.
Example:
{
"questions": [
{
"statement": "...",
"correct_answer": "...",
"plausible_distractors": [
"...",
"...",
"..."
],
"explanation": "..."
}
]
}
Training Data
The adapter was trained on a synthetic dataset derived from the Egyptian secondary English curriculum.
The dataset contains prompts covering:
- Grammar Focus
- Vocabulary
- Topics
- Units
- Curriculum metadata
- Official Ministry-style multiple-choice questions
Training Configuration
- Base Model: Qwen2.5-3B-Instruct
- LoRA Rank: 16
- LoRA Alpha: 32
- LoRA Dropout: 0.05
- Sequence Length: 2048
- Optimizer: AdamW 8-bit
- Learning Rate: 1e-4
Usage
from unsloth import FastLanguageModel
from peft import PeftModel
model, tokenizer = FastLanguageModel.from_pretrained(
"unsloth/Qwen2.5-3B-Instruct",
max_seq_length=2048,
)
model = PeftModel.from_pretrained(
model,
"tokhey/egyptian-mcq-generator-qwen-2.5-3b-adapter",
)
FastLanguageModel.for_inference(model)
Intended Use
This adapter is designed for:
- Educational applications
- Automatic English exam generation
- Ministry-style assessment generation
- Question authoring assistants
It is not intended for general-purpose chat or reasoning tasks.