Egyptian Ministry English MCQ Generator (LoRA Adapter)

This repository contains a LoRA adapter fine-tuned on Qwen2.5-3B-Instruct for generating English multiple-choice questions following the style of the Egyptian Ministry of Education (General Secondary Stage).

Base Model

  • Model: unsloth/Qwen2.5-3B-Instruct
  • Fine-tuning Method: LoRA (PEFT)
  • Framework: Unsloth + TRL

Task

The adapter is trained to generate ministry-style English examination questions, including:

  • Grammar
  • Vocabulary
  • Unit-based questions
  • Topic-based questions

The generated output follows a structured JSON format.

Example:

{
  "questions": [
    {
      "statement": "...",
      "correct_answer": "...",
      "plausible_distractors": [
        "...",
        "...",
        "..."
      ],
      "explanation": "..."
    }
  ]
}

Training Data

The adapter was trained on a synthetic dataset derived from the Egyptian secondary English curriculum.

The dataset contains prompts covering:

  • Grammar Focus
  • Vocabulary
  • Topics
  • Units
  • Curriculum metadata
  • Official Ministry-style multiple-choice questions

Training Configuration

  • Base Model: Qwen2.5-3B-Instruct
  • LoRA Rank: 16
  • LoRA Alpha: 32
  • LoRA Dropout: 0.05
  • Sequence Length: 2048
  • Optimizer: AdamW 8-bit
  • Learning Rate: 1e-4

Usage

from unsloth import FastLanguageModel
from peft import PeftModel

model, tokenizer = FastLanguageModel.from_pretrained(
    "unsloth/Qwen2.5-3B-Instruct",
    max_seq_length=2048,
)

model = PeftModel.from_pretrained(
    model,
    "tokhey/egyptian-mcq-generator-qwen-2.5-3b-adapter",
)

FastLanguageModel.for_inference(model)

Intended Use

This adapter is designed for:

  • Educational applications
  • Automatic English exam generation
  • Ministry-style assessment generation
  • Question authoring assistants

It is not intended for general-purpose chat or reasoning tasks.

Downloads last month
67
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for tokhey/egyptian-mcq-generator-qwen-2.5-3b-adapter

Base model

Qwen/Qwen2.5-3B
Adapter
(476)
this model