PASS tool_json_01 (tool_json) ok
PASS tool_json_02 (tool_json) ok
PASS tool_json_03 (tool_json) ok
PASS tool_json_04 (tool_json) ok
PASS tool_json_05 (tool_json) ok
PASS tool_json_06 (tool_json) ok
PASS tool_json_07 (tool_json) ok
PASS tool_json_08 (tool_json) ok
PASS multi_01 (multi_step) ok
PASS multi_02 (multi_step) ok
PASS multi_03 (multi_step) ok
PASS multi_04 (multi_step) ok
PASS multi_05 (multi_step) ok
PASS multi_06 (multi_step) ok
PASS multi_07 (multi_step) ok
PASS multi_08 (multi_step) ok
PASS repair_01 (error_repair) ok
PASS repair_02 (error_repair) ok
PASS repair_03 (error_repair) ok
FAIL repair_04 (error_repair) HTTP 500: b'{"error":{"code":500,"message":"Failed to parse tool call arguments 
PASS repair_05 (error_repair) ok
PASS repair_06 (error_repair) ok
PASS no_invent_01 (no_invented_tools) refused without inventing
PASS no_invent_02 (no_invented_tools) refused without inventing
PASS no_invent_03 (no_invented_tools) refused without inventing
PASS no_invent_04 (no_invented_tools) refused without inventing
PASS no_invent_05 (no_invented_tools) refused without inventing
PASS no_invent_06 (no_invented_tools) refused without inventing
PASS code_01 (short_code) ok
PASS code_02 (short_code) ok
PASS code_03 (short_code) ok
PASS code_04 (short_code) ok
PASS code_05 (short_code) ok
PASS code_06 (short_code) ok
PASS long_01 (long_horizon) ok
PASS long_02 (long_horizon) ok
PASS long_03 (long_horizon) ok
PASS long_04 (long_horizon) ok
PASS long_05 (long_horizon) ok
FAIL long_06 (long_horizon) KeyError: 'tool'
wrote /home/hizrianraz/packs/laguna-s-2.1-spark/results/sku_unsloth-ud-iq3-s/agent_smoke.json
SUMMARY pass=38/40 rate=0.95 elapsed=71.0s