Commit History

fix: MistralJudge schema detection for truths/claims/verdicts β€” matches DeepEval 3-call pattern (Day 15)
ce15608

Mukul Rayana commited on

fix: MistralJudge uses from_json_schema grammar β€” correct structure for claim extraction and verification (Day 15)
5405e38

Mukul Rayana commited on

fix: GBNF grammar-constrained JSON sampling in MistralJudge β€” eliminates DeepEval JSON parse errors (Day 15)
c9853ac

Mukul Rayana commited on

fix: MistralJudge JSON extraction for DeepEval faithfulness, commit Wilcoxon results (Day 15)
2668471

Mukul Rayana commited on

fix: wilcoxon sys.path for condition_a import, zero_method=pratt for binary scores (Day 15)
7fc5654

Mukul Rayana commited on

fix: Wilcoxon uses stub guardrail β€” tests retrieval quality on all 50 prompts not 13 (Day 15)
68b0d74

Mukul Rayana commited on

feat: DeepEval FaithfulnessMetric with Mistral judge, async_mode=False (replaces RAGAS, Day 15)
d02b074

Mukul Rayana commited on

fix: guardrail dual-import path, bertscore key names, ragas reuse pipeline.llm (Day 14)
9bce0e0

Mukul Rayana commited on

eval: save adversarial results at both t=0.50 and t=0.85, reset production threshold to 0.50 (Day 14)
9f77f5f

Mukul Rayana commited on

fix: threshold sweep β€” calibrate DeBERTa guardrail threshold, patch eval imports (Day 14)
d5f8958

Mukul Rayana commited on

feat: eval scripts β€” BM25 baseline, adversarial probes, BERTScore, RAGAS, Wilcoxon (Day 14)
78fc1e6

Mukul Rayana commited on

feat: Gradio demo app, DeBERTa Colab notebook, updated smoke test results (Day 13)
d471138

Mukul Rayana commited on

feat: real DeBERTa guardrail wired, skip_ig flag, smoke test updated
6997a58

Mukul Rayana commited on

feat: wire real DeBERTa guardrail, fix smoke test for crisis intercepts
2e53d50

Mukul Rayana commited on

fix: wire real guardrail, anchor gitignore, fix dtype warning
1afd5d5

Mukul Rayana commited on

fix: anchor /models/ gitignore to repo root only
54ec024

Mukul Rayana commited on

fix: guardrail_ig.py β€” IG in embedding space, token_type_ids, correct dtype
6535fa7

Mukul Rayana commited on

fix: scope models/ gitignore to root only, add src/models package, remove .claude
0e9c4c7

Mukul Rayana commited on

fix .gitignore
e9f8122

Mukul Rayana commited on

Add Colab notebooks: emotion classifier + corpus annotation (Day 12)
ae3aa18

Mukul Rayana commited on

Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12)
5c84477

Mukul Rayana commited on

Add pipeline orchestrator + smoke test β€” 4/5 emotion predictions correct (Day 12)
8b1f355

Mukul Rayana commited on

Day 3: correct gitignore, add data manifest
713dff4

Mukul Rayana commited on

Day 3: proper Colab ipynb notebook for FAISS build
dad49b3

Mukul Rayana commited on

Day 3: FAISS index builder notebook for Colab A100
257c78b

Mukul Rayana commited on

chore: keep requirements-lock.txt tracked for reproducibility
1e8d364

Mukul Rayana commited on

Day 2: NLI pairs built, fix gitignore for large files
ecf7f72

Mukul Rayana commited on

Day 1: data pipeline, session tracker, query router, adversarial probes, Colab training notebooks
bc3ba9e

Mukul Rayana commited on

chore: freeze installed dependency versions
f9c38da

Mukul Rayana commited on

Initial commit
cb29566

Mukul Rayana commited on