erayyapagci commited on
Commit
681a096
·
verified ·
1 Parent(s): 2b0b205

Upload model card, weights, and evaluation artifacts

Browse files
README.md CHANGED
@@ -32,20 +32,44 @@ This model is designed to detect question regions in exam booklets, worksheets,
32
 
33
  This release checkpoint was trained for 50 epochs on the cleaned one-class question detection dataset.
34
 
 
 
35
  ## Test results
36
 
37
  ### Old held-out test set
38
 
39
  | Model | Precision | Recall | mAP50 | mAP50-95 |
40
  | --- | --- | --- | --- | --- |
 
 
41
  | YOLO26N Question Segmentation | 0.988 | 0.983 | 0.989 | 0.924 |
42
 
43
  ### Combined held-out test set
44
 
45
  | Model | Precision | Recall | mAP50 | mAP50-95 |
46
  | --- | --- | --- | --- | --- |
 
 
47
  | YOLO26N Question Segmentation | 0.991 | 0.988 | 0.993 | 0.962 |
48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ## Usage
50
 
51
  ```python
 
32
 
33
  This release checkpoint was trained for 50 epochs on the cleaned one-class question detection dataset.
34
 
35
+ Compared with the previously published HF YOLO11M baseline, this release improves held-out mAP50-95 by `+0.026` on the old test set and `+0.062` on the combined test set.
36
+
37
  ## Test results
38
 
39
  ### Old held-out test set
40
 
41
  | Model | Precision | Recall | mAP50 | mAP50-95 |
42
  | --- | --- | --- | --- | --- |
43
+ | HF YOLO11M | 0.962 | 0.980 | 0.979 | 0.898 |
44
+ | YOLO26M Question Segmentation | 0.990 | 0.982 | 0.988 | 0.920 |
45
  | YOLO26N Question Segmentation | 0.988 | 0.983 | 0.989 | 0.924 |
46
 
47
  ### Combined held-out test set
48
 
49
  | Model | Precision | Recall | mAP50 | mAP50-95 |
50
  | --- | --- | --- | --- | --- |
51
+ | HF YOLO11M | 0.962 | 0.973 | 0.984 | 0.900 |
52
+ | YOLO26M Question Segmentation | 0.987 | 0.978 | 0.992 | 0.957 |
53
  | YOLO26N Question Segmentation | 0.991 | 0.988 | 0.993 | 0.962 |
54
 
55
+ ### Benchmark graphs
56
+
57
+ ![Held-out mAP50-95](benchmark_map50_95.png)
58
+ ![Held-out precision and recall](benchmark_precision_recall.png)
59
+
60
+ ## Qualitative examples
61
+
62
+ The newer YOLO26 checkpoints improve most clearly in two cases:
63
+
64
+ - Less false positives on pages with no questions.
65
+ - Better recovery of harder placements such as one-row questions and questions that occupy an entire column.
66
+
67
+ Example page with no saved questions: GT + HF YOLO11M + YOLO26M + YOLO26N.
68
+
69
+ ![No-question page comparison](comparison_examples/10__sourcepdf__yks_tyt_2025_kitapcik_d250__page_1.png)
70
+
71
+ Additional side-by-side examples are included in `comparison_examples/`.
72
+
73
  ## Usage
74
 
75
  ```python
benchmark_map50_95.png ADDED
benchmark_precision_recall.png ADDED