Delentia/delentia-slm-jitna-router

Delentia SLM — The Router (slm-jitna-router)

The Router is a specialized Sequence Classification LoRA adapter within the Delentia OS 1+4 Pillar Architecture. Its primary role is to intercept incoming user intents and classify them into one of the specialized execution pathways at ultra-low latency.

Technical Specifications

• Base Model: unsloth/Meta-Llama-3.1-8B-bnb-4bit
• Fine-Tuning Method: Sequence Classification QLoRA (SEQ_CLS adapter)
• Target Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
• Output Labels:
  • 0: Executor (Tool / JSON Execution)
  • 1: Router Base (Conversational / Standard Prompt)
  • 2: Guardian (Safety Shield evaluation)
  • 3: Scribe (Context compression/summarization)

Optimization Details

• Zero Static Padding: Re-engineered training pipeline removes static padding and reduces input context to max_length=512.
• Inference Latency: 20-50 milliseconds on consumer-grade local hardware, enabling instantaneous routing decisions.
• Accuracy Gate: Achieved $\ge 96%$ intent classification accuracy on JITNA router evaluation dataset.