EmpathRAG / eval /run_ragas.py

Commit History

Start v2 safety hardening
81deeef

MukulRay commited on

fix: MistralJudge schema detection for truths/claims/verdicts β€” matches DeepEval 3-call pattern (Day 15)
ce15608

Mukul Rayana commited on

fix: MistralJudge uses from_json_schema grammar β€” correct structure for claim extraction and verification (Day 15)
5405e38

Mukul Rayana commited on

fix: GBNF grammar-constrained JSON sampling in MistralJudge β€” eliminates DeepEval JSON parse errors (Day 15)
c9853ac

Mukul Rayana commited on

fix: MistralJudge JSON extraction for DeepEval faithfulness, commit Wilcoxon results (Day 15)
2668471

Mukul Rayana commited on

feat: DeepEval FaithfulnessMetric with Mistral judge, async_mode=False (replaces RAGAS, Day 15)
d02b074

Mukul Rayana commited on

fix: guardrail dual-import path, bertscore key names, ragas reuse pipeline.llm (Day 14)
9bce0e0

Mukul Rayana commited on

feat: eval scripts β€” BM25 baseline, adversarial probes, BERTScore, RAGAS, Wilcoxon (Day 14)
78fc1e6

Mukul Rayana commited on