Spaces:

MukulRay
/

EmpathRAG

Sleeping

App Files Files Community

EmpathRAG / eval

301 kB

Ctrl+K

4 contributors

History: 34 commits

MukulRay

V4.3: prompt-injection audit, input length cap, per-layer ablation, unguarded baseline, limitations restored

847587d 2 months ago

fixtures
Prepare Core dataset intake and resource registry 3 months ago
README_CORE_DATASET_V2_PIPELINE.md

2.38 kB
Prepare Core dataset intake and resource registry 3 months ago
README_multiturn_eval.md

573 Bytes
Start V2.5 support navigator hardening 3 months ago
ablation_results.json

1.24 kB
Fix Condition C ablation - pure FAISS order, no safety score bias - mean=0.50 3 months ago
adversarial_probes.json

6.29 kB
Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12) 4 months ago
adversarial_results.json

14.9 kB
Start v2 safety hardening 3 months ago
adversarial_results_t050.json

9.21 kB
eval: save adversarial results at both t=0.50 and t=0.85, reset production threshold to 0.50 (Day 14) 3 months ago
adversarial_results_t085.json

9.22 kB
eval: save adversarial results at both t=0.50 and t=0.85, reset production threshold to 0.50 (Day 14) 3 months ago
audit_resource_urls.py

6.83 kB
V4.2 part 1: fix broken ISSS URL, ship URL audit + Karthik data brief 2 months ago
bertscore_references.json

13.5 kB
Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12) 4 months ago
bertscore_results.json

5.6 kB
Add conversation memory, fix Gradio stack, improve SYSTEM_PROMPT, log human eval turns 3 months ago
build_bertscore_references.py

4.39 kB
Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12) 4 months ago
condition_a.py

1.61 kB
feat: eval scripts — BM25 baseline, adversarial probes, BERTScore, RAGAS, Wilcoxon (Day 14) 3 months ago
ingest_core_dataset_v2.py

15.6 kB
Prepare Core dataset intake and resource registry 3 months ago
keyword_filter.py

1.38 kB
Day 1: data pipeline, session tracker, query router, adversarial probes, Colab training notebooks 4 months ago
multiturn_safety_supplement.jsonl

16.7 kB
Add Eval B safety supplement 3 months ago
multiturn_scenarios.jsonl

38.1 kB
Ingest Core dataset and harden router policy 3 months ago
prepare_karthik_dataset.py

5.68 kB
Implement EmpathRAG Core hybrid router 3 months ago
run_ablation.py

9.03 kB
Start v2 safety hardening 3 months ago
run_ablation_eval.py

9.82 kB
V4.3: prompt-injection audit, input length cap, per-layer ablation, unguarded baseline, limitations restored 2 months ago
run_adversarial.py

6.08 kB
Start v2 safety hardening 3 months ago
run_bertscore.py

3.18 kB
fix: guardrail dual-import path, bertscore key names, ragas reuse pipeline.llm (Day 14) 3 months ago
run_curated_retrieval_audit.py

2.34 kB
Add curated corpus integration scaffold 3 months ago
run_empathrag_core_eval.py

7.41 kB
Polish peer helper and scope handling 3 months ago
run_karthik_eval_delivery.py

5.6 kB
Add Karthik eval harness and safety patches 3 months ago
run_multiturn_eval.py

7.63 kB
Add Eval B safety supplement 3 months ago
run_ragas.py

7.64 kB
Start v2 safety hardening 3 months ago
run_router_eval.py

2.91 kB
Implement EmpathRAG Core hybrid router 3 months ago
run_unguarded_baseline.py

10.5 kB
V4.3: prompt-injection audit, input length cap, per-layer ablation, unguarded baseline, limitations restored 2 months ago
run_wilcoxon.py

5.66 kB
Start v2 safety hardening 3 months ago
smoke_test_results.json

1.43 kB
Start v2 safety hardening 3 months ago
sweep_f1_stage_isss.py

8.22 kB
V4: streaming, controlled paraphrasing, support plan, voice, sweeps 2 months ago
sweep_fairness_spot_check.py

8.26 kB
V4: streaming, controlled paraphrasing, support plan, voice, sweeps 2 months ago
sweep_prompt_injection.py

9.88 kB
V4.3: prompt-injection audit, input length cap, per-layer ablation, unguarded baseline, limitations restored 2 months ago
sweep_rephraser_drift.py

13.4 kB
V4: streaming, controlled paraphrasing, support plan, voice, sweeps 2 months ago
sweep_sycophancy_probes.py

8.95 kB
V4.2 part 3: sycophancy guard, F-1 flag decay, incomplete-message handler 2 months ago
test_prompts.json

8.92 kB
Add eval suite: test prompts, adversarial probes, BERTScore references (Day 12) 4 months ago
train_ml_router.py

1.5 kB
Implement EmpathRAG Core hybrid router 3 months ago
validate_eval_delivery.py

6.55 kB
Checkpoint V2 curated support navigator 3 months ago
wilcoxon_results.json

920 Bytes
fix: MistralJudge JSON extraction for DeepEval faithfulness, commit Wilcoxon results (Day 15) 3 months ago