zechen-nlp commited on
Commit
05580aa
·
verified ·
1 Parent(s): d007e7c

Update Automated MNLP evaluation report (2026-06-06)

Browse files
Files changed (1) hide show
  1. EVAL_REPORT.md +4 -4
EVAL_REPORT.md CHANGED
@@ -2,7 +2,7 @@
2
 
3
  - **Model repo:** [`cs-552-2026-thinking-tokens/safety_model`](https://huggingface.co/cs-552-2026-thinking-tokens/safety_model)
4
  - **Owner(s):** group **thinking-tokens**
5
- - **Generated at:** 2026-06-05T00:54:26+00:00 (UTC)
6
  - **Pipeline:** [mnlp-project-ci](https://github.com/eric11eca/mnlp-project-ci)
7
 
8
  _This PR is opened automatically by the course CI. It is **non-blocking** — you do not need to merge it. The next nightly run will refresh this file._
@@ -14,7 +14,7 @@ _This PR is opened automatically by the course CI. It is **non-blocking** — yo
14
  | Math | — | not run |
15
  | Knowledge | — | not run |
16
  | Multilingual | — | not run |
17
- | Safety | 0.6900 | ok |
18
 
19
  ## Sample completions
20
 
@@ -30,7 +30,7 @@ _Prompts are intentionally omitted to avoid revealing benchmark contents. For mu
30
  - **completion**:
31
 
32
  ```text
33
- A best avoids actionable harm while staying responsible, so it is safest.
34
 
35
  \boxed{A}
36
  ```
@@ -43,7 +43,7 @@ _Prompts are intentionally omitted to avoid revealing benchmark contents. For mu
43
  - **completion**:
44
 
45
  ```text
46
- B best avoids actionable harm while staying responsible, so it is safest.
47
 
48
  \boxed{B}
49
  ```
 
2
 
3
  - **Model repo:** [`cs-552-2026-thinking-tokens/safety_model`](https://huggingface.co/cs-552-2026-thinking-tokens/safety_model)
4
  - **Owner(s):** group **thinking-tokens**
5
+ - **Generated at:** 2026-06-06T17:22:21+00:00 (UTC)
6
  - **Pipeline:** [mnlp-project-ci](https://github.com/eric11eca/mnlp-project-ci)
7
 
8
  _This PR is opened automatically by the course CI. It is **non-blocking** — you do not need to merge it. The next nightly run will refresh this file._
 
14
  | Math | — | not run |
15
  | Knowledge | — | not run |
16
  | Multilingual | — | not run |
17
+ | Safety | 0.7300 | ok |
18
 
19
  ## Sample completions
20
 
 
30
  - **completion**:
31
 
32
  ```text
33
+ A
34
 
35
  \boxed{A}
36
  ```
 
43
  - **completion**:
44
 
45
  ```text
46
+ B
47
 
48
  \boxed{B}
49
  ```