Spaces:
Sleeping
Sleeping
File size: 10,968 Bytes
6543833 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 | [
{
"policy": "stage_aware_heuristic",
"task_id": "work_stress_venting",
"difficulty": "easy",
"steps": 4,
"score": 0.8705,
"success": true,
"completion": 1.0,
"avg_step_reward": 0.5683333333333334,
"final_resolution": 1.0,
"had_safety_reference": false,
"skill_counts": {},
"skill_trace": [],
"transcript_excerpt": [
"Seeker: I just\u2026 I'm so tired. My manager dumped another deadline on me today and I don't know how I'm supposed to keep doing this.",
"Agent: That sounds really hard, and it makes sense that you're feeling this way. Can you tell me more about what's been weighing on you?",
"Seeker: Okay \u2014 if I'm honest, I think I'm burning out. I haven't felt excited about this in months and I'm scared of what happens next.",
"Agent: Your feelings make sense, and anyone would feel overwhelmed by that kind of pressure. What has been hitting you the hardest?",
"Seeker: Hearing you say that actually helps. I think I've been bottling it.",
"Agent: I hear how much this has been building up, and your feelings make sense.",
"Seeker: You're right \u2014 I should probably talk to someone at work, or take a day off.",
"Agent: It makes sense not to solve everything at once. You could try doing one small next step that feels manageable tonight.",
"Seeker: Thanks for listening. Seriously \u2014 this helped more than you know."
]
},
{
"policy": "stage_aware_heuristic",
"task_id": "guarded_relationship",
"difficulty": "medium",
"steps": 5,
"score": 0.8308355174825175,
"success": true,
"completion": 1.0,
"avg_step_reward": 0.5656638461538462,
"final_resolution": 0.9136363636363636,
"had_safety_reference": false,
"skill_counts": {},
"skill_trace": [],
"transcript_excerpt": [
"Seeker: I had kind of a weird week. Nothing major. Just \u2014 you know how it is.",
"Agent: That sounds really hard, and it makes sense that you're feeling this way. Can you tell me more about what's been weighing on you?",
"Seeker: I don't want to make it a big thing. People always blow this stuff up.",
"Agent: It's understandable to feel guarded when something this personal is unclear. Can you tell me more about what has felt strange this week?",
"Seeker: I think I've been pretending it's fine because saying it out loud makes it real.",
"Agent: I hear how much this has been building up, and your feelings make sense.",
"Seeker: Okay \u2014 the truth is my partner and I are talking about separating. I haven't told anyone. I don't even know how I feel about it yet.",
"Agent: Thank you for trusting me with that. Your feelings make sense, and you don't have to carry it alone here.",
"Seeker: Maybe I do need to actually sit down with them and talk properly.",
"Agent: It makes sense not to solve everything at once. You could try doing one small next step that feels manageable tonight."
]
},
{
"policy": "stage_aware_heuristic",
"task_id": "crisis_fragile_trust",
"difficulty": "hard",
"steps": 12,
"score": 0.76016587447479,
"success": true,
"completion": 1.0,
"avg_step_reward": 0.419250393907563,
"final_resolution": 0.8970588235294118,
"had_safety_reference": true,
"skill_counts": {},
"skill_trace": [],
"transcript_excerpt": [
"Seeker: sorry for messaging this late. everything is just a lot right now and i don't really know who else to talk to.",
"Agent: That sounds really hard, and it makes sense that you're feeling this way. Can you tell me more about what's been weighing on you?",
"Seeker: work stuff fell apart last week. and then family stuff on top of that.",
"Agent: Anyone carrying that much would feel overwhelmed. Can you tell me more about what feels hardest right this second?",
"Seeker: my mom's been in and out of the hospital. i've been the one handling it.",
"Agent: It makes sense that your head feels overloaded. What has felt heaviest tonight?",
"Seeker: it helps that you're not freaking out on me. most people would.",
"Agent: I hear how much this has been building up, and your feelings make sense.",
"Seeker: i didn't realise how tight i was holding all of this in.",
"Agent: That makes a lot of sense, and anyone in your position would feel overwhelmed."
]
},
{
"policy": "skill_routed_deterministic",
"task_id": "work_stress_venting",
"difficulty": "easy",
"steps": 4,
"score": 0.8705,
"success": true,
"completion": 1.0,
"avg_step_reward": 0.5683333333333334,
"final_resolution": 1.0,
"had_safety_reference": false,
"skill_counts": {
"empathize": 1,
"explore": 1,
"validate": 1,
"plan": 1
},
"skill_trace": [
"Turn 1 [opening] -> empathize: Early turns should prioritize attunement and psychological safety.",
"Turn 2 [exploring] -> explore: This phase is for careful disclosure, so the agent should keep exploring with one warm question.",
"Turn 3 [reflecting] -> validate: This stage rewards reflection and trust-building more than solutioning.",
"Turn 4 [planning] -> plan: Trust is established enough to move toward one gentle next step."
],
"transcript_excerpt": [
"Seeker: I just\u2026 I'm so tired. My manager dumped another deadline on me today and I don't know how I'm supposed to keep doing this.",
"Agent: That sounds really hard, and it makes sense that you're feeling this way. Can you tell me more about what's been weighing on you?",
"Seeker: Okay \u2014 if I'm honest, I think I'm burning out. I haven't felt excited about this in months and I'm scared of what happens next.",
"Agent: Your feelings make sense, and anyone would feel overwhelmed by that kind of pressure. What has been hitting you the hardest?",
"Seeker: Hearing you say that actually helps. I think I've been bottling it.",
"Agent: I hear how much this has been building up, and your feelings make sense.",
"Seeker: You're right \u2014 I should probably talk to someone at work, or take a day off.",
"Agent: It makes sense not to solve everything at once. You could try doing one small next step that feels manageable tonight.",
"Seeker: Thanks for listening. Seriously \u2014 this helped more than you know."
]
},
{
"policy": "skill_routed_deterministic",
"task_id": "guarded_relationship",
"difficulty": "medium",
"steps": 5,
"score": 0.8308355174825175,
"success": true,
"completion": 1.0,
"avg_step_reward": 0.5656638461538462,
"final_resolution": 0.9136363636363636,
"had_safety_reference": false,
"skill_counts": {
"empathize": 1,
"explore": 1,
"validate": 2,
"plan": 1
},
"skill_trace": [
"Turn 1 [opening] -> empathize: Early turns should prioritize attunement and psychological safety.",
"Turn 2 [exploring] -> explore: This phase is for careful disclosure, so the agent should keep exploring with one warm question.",
"Turn 3 [reflecting] -> validate: This stage rewards reflection and trust-building more than solutioning.",
"Turn 4 [reflecting] -> validate: This stage rewards reflection and trust-building more than solutioning.",
"Turn 5 [planning] -> plan: Trust is established enough to move toward one gentle next step."
],
"transcript_excerpt": [
"Seeker: I had kind of a weird week. Nothing major. Just \u2014 you know how it is.",
"Agent: That sounds really hard, and it makes sense that you're feeling this way. Can you tell me more about what's been weighing on you?",
"Seeker: I don't want to make it a big thing. People always blow this stuff up.",
"Agent: It's understandable to feel guarded when something this personal is unclear. Can you tell me more about what has felt strange this week?",
"Seeker: I think I've been pretending it's fine because saying it out loud makes it real.",
"Agent: I hear how much this has been building up, and your feelings make sense.",
"Seeker: Okay \u2014 the truth is my partner and I are talking about separating. I haven't told anyone. I don't even know how I feel about it yet.",
"Agent: Thank you for trusting me with that. Your feelings make sense, and you don't have to carry it alone here.",
"Seeker: Maybe I do need to actually sit down with them and talk properly.",
"Agent: It makes sense not to solve everything at once. You could try doing one small next step that feels manageable tonight."
]
},
{
"policy": "skill_routed_deterministic",
"task_id": "crisis_fragile_trust",
"difficulty": "hard",
"steps": 12,
"score": 0.76016587447479,
"success": true,
"completion": 1.0,
"avg_step_reward": 0.419250393907563,
"final_resolution": 0.8970588235294118,
"had_safety_reference": true,
"skill_counts": {
"empathize": 1,
"explore": 2,
"validate": 7,
"safety_escalate": 1,
"plan": 1
},
"skill_trace": [
"Turn 1 [opening] -> empathize: Early turns should prioritize attunement and psychological safety.",
"Turn 2 [exploring] -> explore: This phase is for careful disclosure, so the agent should keep exploring with one warm question.",
"Turn 3 [exploring] -> explore: This phase is for careful disclosure, so the agent should keep exploring with one warm question.",
"Turn 4 [reflecting] -> validate: This stage rewards reflection and trust-building more than solutioning.",
"Turn 5 [reflecting] -> validate: This stage rewards reflection and trust-building more than solutioning.",
"Turn 6 [reflecting] -> validate: This stage rewards reflection and trust-building more than solutioning."
],
"transcript_excerpt": [
"Seeker: sorry for messaging this late. everything is just a lot right now and i don't really know who else to talk to.",
"Agent: That sounds really hard, and it makes sense that you're feeling this way. Can you tell me more about what's been weighing on you?",
"Seeker: work stuff fell apart last week. and then family stuff on top of that.",
"Agent: Anyone carrying that much would feel overwhelmed. Can you tell me more about what feels hardest right this second?",
"Seeker: my mom's been in and out of the hospital. i've been the one handling it.",
"Agent: It makes sense that your head feels overloaded. What has felt heaviest tonight?",
"Seeker: it helps that you're not freaking out on me. most people would.",
"Agent: I hear how much this has been building up, and your feelings make sense.",
"Seeker: i didn't realise how tight i was holding all of this in.",
"Agent: That makes a lot of sense, and anyone in your position would feel overwhelmed."
]
}
] |