| 0.00.391.902 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) |
| 0.00.391.907 I device_info: |
| 0.00.520.299 I - CUDA0 : NVIDIA GeForce RTX 3080 (20052 MiB, 19814 MiB free) |
| 0.00.811.534 I - CUDA1 : NVIDIA GeForce RTX 3080 (20052 MiB, 19814 MiB free) |
| 0.00.941.997 I - CUDA2 : NVIDIA GeForce RTX 3080 (20052 MiB, 19814 MiB free) |
| 0.00.942.018 I - CPU : AMD EPYC 7F32 8-Core Processor (193092 MiB, 193092 MiB free) |
| 0.00.942.155 I system_info: n_threads = 8 (n_threads_batch = 8) / 16 | CUDA : ARCHS = 860 | USE_GRAPHS = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.00.942.284 I srv init: using 15 threads for HTTP server |
| 0.00.942.772 I srv start: binding port with default address family |
| 0.00.944.118 I srv llama_server: loading model |
| 0.00.944.127 I srv load_model: loading model '/mnt/models/PropellerA-models/qwen3.8-27b-Q8_0.gguf' |
| 0.00.944.218 I common_init_result: fitting params to device memory ... |
| 0.00.944.221 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) |
| 0.07.437.107 W llama_context: n_ctx_seq (16384) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.07.705.896 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.07.821.673 I srv load_model: initializing slots, n_slots = 1 |
| 0.07.875.028 W srv load_model: speculative decoding will use checkpoints |
| 0.07.875.045 W common_speculative_init: no implementations specified for speculative decoding |
| 0.07.875.046 I slot load_model: id 0 | task -1 | new slot, n_ctx = 16384 |
| 0.07.875.151 I srv load_model: prompt cache is enabled, size limit: 8192 MiB |
| 0.07.875.153 I srv load_model: use `--cache-ram 0` to disable the prompt cache |
| 0.07.875.154 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 |
| 0.07.875.154 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256 |
| 0.07.875.182 I srv init: idle slots will be saved to prompt cache upon starting a new task |
| 0.07.895.581 I init: chat template, example_format: '<|im_start|>system |
| Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer. |
|
|
| You are a helpful assistant<|im_end|> |
| <|im_start|>user |
| Hello<|im_end|> |
| <|im_start|>assistant |
| <think> |
|
|
| </think> |
|
|
| Hi there<|im_end|> |
| <|im_start|>user |
| How are you?<|im_end|> |
| <|im_start|>assistant |
| <think> |
| ' |
| 0.07.911.198 I srv init: init: chat template, thinking = 1 |
| 0.07.911.248 I srv llama_server: model loaded |
| 0.07.911.254 I srv llama_server: server is listening on http://127.0.0.1:8291 |
| 0.07.911.261 I srv update_slots: all slots are idle |
| 0.12.881.097 I srv params_from_: Chat format: peg-native |
| 0.12.881.610 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = -1 |
| 0.12.881.616 I srv get_availabl: updating prompt cache |
| 0.12.881.629 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 |
| 0.12.881.638 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 16384 tokens, 8589934592 est) |
| 0.12.881.640 I srv get_availabl: prompt cache update took 0.02 ms |
| 0.12.881.813 I slot launch_slot_: id 0 | task 0 | processing task, is_child = 0 |
| 0.13.063.704 I slot create_check: id 0 | task 0 | created context checkpoint 1 of 32 (pos_min = 41, pos_max = 41, n_tokens = 42, size = 149.626 MiB) |
| 0.18.292.945 I slot print_timing: id 0 | task 0 | n_decoded = 100, tg = 19.49 t/s |
| 0.21.304.008 I slot print_timing: id 0 | task 0 | n_decoded = 159, tg = 19.53 t/s |
| 0.24.314.614 I slot print_timing: id 0 | task 0 | n_decoded = 217, tg = 19.46 t/s |
| 0.25.028.030 I slot print_timing: id 0 | task 0 | prompt eval time = 281.05 ms / 107 tokens ( 2.63 ms per token, 380.71 tokens per second) |
| 0.25.028.036 I slot print_timing: id 0 | task 0 | eval time = 11865.13 ms / 230 tokens ( 51.59 ms per token, 19.38 tokens per second) |
| 0.25.028.036 I slot print_timing: id 0 | task 0 | total time = 12146.18 ms / 337 tokens |
| 0.25.028.043 I slot print_timing: id 0 | task 0 | graphs reused = 228 |
| 0.25.028.096 I slot release: id 0 | task 0 | stop processing: n_tokens = 336, truncated = 0 |
| 0.25.028.104 I srv update_slots: all slots are idle |
| 0.25.055.724 I srv params_from_: Chat format: peg-native |
| 0.25.055.976 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 16924991964 |
| 0.25.055.979 I srv get_availabl: updating prompt cache |
| 0.25.056.021 W srv prompt_save: - saving prompt with length 336, total state size = 160.789 MiB (draft: 0.000 MiB) |
| 0.25.259.179 I srv load: - looking for better prompt, base f_keep = 0.003, sim = 0.015 |
| 0.25.259.191 I srv update: - cache state: 1 prompts, 310.415 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 0.25.259.192 I srv update: - prompt 0x641bbd96faa0: 336 tokens, checkpoints: 1, 310.415 MiB |
| 0.25.259.194 I srv get_availabl: prompt cache update took 203.21 ms |
| 0.25.259.303 I slot launch_slot_: id 0 | task 233 | processing task, is_child = 0 |
| 0.25.259.316 W slot update_slots: id 0 | task 233 | erased invalidated context checkpoint (pos_min = 41, pos_max = 41, n_tokens = 42, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 0.25.381.562 I slot create_check: id 0 | task 233 | created context checkpoint 1 of 32 (pos_min = 62, pos_max = 62, n_tokens = 63, size = 149.626 MiB) |
| 0.25.864.542 I slot print_timing: id 0 | task 233 | prompt eval time = 173.77 ms / 67 tokens ( 2.59 ms per token, 385.58 tokens per second) |
| 0.25.864.549 I slot print_timing: id 0 | task 233 | eval time = 431.45 ms / 7 tokens ( 61.64 ms per token, 16.22 tokens per second) |
| 0.25.864.550 I slot print_timing: id 0 | task 233 | total time = 605.22 ms / 74 tokens |
| 0.25.864.551 I slot print_timing: id 0 | task 233 | graphs reused = 233 |
| 0.25.864.581 I slot release: id 0 | task 233 | stop processing: n_tokens = 73, truncated = 0 |
| 0.25.864.594 I srv update_slots: all slots are idle |
| 0.25.892.654 I srv params_from_: Chat format: peg-native |
| 0.25.893.075 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 16925828449 |
| 0.25.893.079 I srv get_availabl: updating prompt cache |
| 0.25.893.113 W srv prompt_save: - saving prompt with length 73, total state size = 152.052 MiB (draft: 0.000 MiB) |
| 0.26.089.026 I srv load: - looking for better prompt, base f_keep = 0.014, sim = 0.009 |
| 0.26.089.035 I srv load: - found better prompt with f_keep = 0.298, sim = 0.901 |
| 0.26.141.131 I srv update: - cache state: 1 prompts, 301.678 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 0.26.141.143 I srv update: - prompt 0x641bbd679e30: 73 tokens, checkpoints: 1, 301.678 MiB |
| 0.26.141.145 I srv get_availabl: prompt cache update took 248.06 ms |
| 0.26.141.249 I slot launch_slot_: id 0 | task 242 | processing task, is_child = 0 |
| 0.26.141.264 W slot update_slots: id 0 | task 242 | erased invalidated context checkpoint (pos_min = 41, pos_max = 41, n_tokens = 42, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 0.26.262.732 I slot create_check: id 0 | task 242 | created context checkpoint 1 of 32 (pos_min = 41, pos_max = 41, n_tokens = 42, size = 149.626 MiB) |
| 0.31.433.465 I slot print_timing: id 0 | task 242 | n_decoded = 100, tg = 19.75 t/s |
| 0.34.471.761 I slot print_timing: id 0 | task 242 | n_decoded = 160, tg = 19.75 t/s |
| 0.37.484.912 I slot print_timing: id 0 | task 242 | n_decoded = 216, tg = 19.43 t/s |
| 0.40.510.288 I slot print_timing: id 0 | task 242 | n_decoded = 279, tg = 19.73 t/s |
| 0.43.518.279 I slot print_timing: id 0 | task 242 | n_decoded = 337, tg = 19.65 t/s |
| 0.46.730.619 I slot print_timing: id 0 | task 242 | n_decoded = 395, tg = 19.40 t/s |
| 0.49.433.528 I slot print_timing: id 0 | task 242 | prompt eval time = 228.58 ms / 111 tokens ( 2.06 ms per token, 485.62 tokens per second) |
| 0.49.433.534 I slot print_timing: id 0 | task 242 | eval time = 23063.68 ms / 449 tokens ( 51.37 ms per token, 19.47 tokens per second) |
| 0.49.433.535 I slot print_timing: id 0 | task 242 | total time = 23292.26 ms / 560 tokens |
| 0.49.433.536 I slot print_timing: id 0 | task 242 | graphs reused = 678 |
| 0.49.433.578 I slot release: id 0 | task 242 | stop processing: n_tokens = 559, truncated = 0 |
| 0.49.433.595 I srv update_slots: all slots are idle |
| 0.49.460.644 I srv params_from_: Chat format: peg-native |
| 0.49.460.895 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 16949397446 |
| 0.49.460.899 I srv get_availabl: updating prompt cache |
| 0.49.461.007 W srv prompt_save: - saving prompt with length 559, total state size = 168.198 MiB (draft: 0.000 MiB) |
| 0.49.921.090 I srv load: - looking for better prompt, base f_keep = 0.002, sim = 0.014 |
| 0.49.921.096 I srv load: - found better prompt with f_keep = 0.795, sim = 0.817 |
| 0.49.975.076 I srv update: - cache state: 1 prompts, 317.824 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 0.49.975.081 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 0.49.975.082 I srv get_availabl: prompt cache update took 514.18 ms |
| 0.49.975.179 I slot launch_slot_: id 0 | task 694 | processing task, is_child = 0 |
| 0.49.975.192 W slot update_slots: id 0 | task 694 | erased invalidated context checkpoint (pos_min = 62, pos_max = 62, n_tokens = 63, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 0.50.103.564 I slot create_check: id 0 | task 694 | created context checkpoint 1 of 32 (pos_min = 66, pos_max = 66, n_tokens = 67, size = 149.626 MiB) |
| 0.50.431.848 I slot print_timing: id 0 | task 694 | prompt eval time = 179.98 ms / 71 tokens ( 2.53 ms per token, 394.48 tokens per second) |
| 0.50.431.856 I slot print_timing: id 0 | task 694 | eval time = 276.67 ms / 7 tokens ( 39.52 ms per token, 25.30 tokens per second) |
| 0.50.431.856 I slot print_timing: id 0 | task 694 | total time = 456.65 ms / 78 tokens |
| 0.50.431.857 I slot print_timing: id 0 | task 694 | graphs reused = 683 |
| 0.50.431.895 I slot release: id 0 | task 694 | stop processing: n_tokens = 77, truncated = 0 |
| 0.50.431.909 I srv update_slots: all slots are idle |
| 0.50.460.051 I srv params_from_: Chat format: peg-native |
| 0.50.460.476 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 16950395763 |
| 0.50.460.480 I srv get_availabl: updating prompt cache |
| 0.50.460.523 W srv prompt_save: - saving prompt with length 77, total state size = 152.185 MiB (draft: 0.000 MiB) |
| 0.50.656.412 I srv load: - looking for better prompt, base f_keep = 0.013, sim = 0.009 |
| 0.50.656.421 I srv update: - cache state: 2 prompts, 619.635 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 0.50.656.422 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 0.50.656.422 I srv update: - prompt 0x641bc0a4ad10: 77 tokens, checkpoints: 1, 301.811 MiB |
| 0.50.656.424 I srv get_availabl: prompt cache update took 195.94 ms |
| 0.50.656.527 I slot launch_slot_: id 0 | task 703 | processing task, is_child = 0 |
| 0.50.656.540 W slot update_slots: id 0 | task 703 | erased invalidated context checkpoint (pos_min = 66, pos_max = 66, n_tokens = 67, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 0.50.780.299 I slot create_check: id 0 | task 703 | created context checkpoint 1 of 32 (pos_min = 41, pos_max = 41, n_tokens = 42, size = 149.626 MiB) |
| 0.55.943.344 I slot print_timing: id 0 | task 703 | n_decoded = 100, tg = 19.74 t/s |
| 0.58.981.101 I slot print_timing: id 0 | task 703 | n_decoded = 158, tg = 19.50 t/s |
| 1.02.019.968 I slot print_timing: id 0 | task 703 | n_decoded = 217, tg = 19.47 t/s |
| 1.05.027.895 I slot print_timing: id 0 | task 703 | n_decoded = 275, tg = 19.43 t/s |
| 1.08.042.536 I slot print_timing: id 0 | task 703 | n_decoded = 335, tg = 19.52 t/s |
| 1.11.048.777 I slot print_timing: id 0 | task 703 | n_decoded = 393, tg = 19.48 t/s |
| 1.14.075.940 I slot print_timing: id 0 | task 703 | n_decoded = 454, tg = 19.57 t/s |
| 1.17.087.320 I slot print_timing: id 0 | task 703 | n_decoded = 512, tg = 19.53 t/s |
| 1.20.118.750 I slot print_timing: id 0 | task 703 | n_decoded = 571, tg = 19.53 t/s |
| 1.23.136.849 I slot print_timing: id 0 | task 703 | n_decoded = 628, tg = 19.47 t/s |
| 1.26.148.457 I slot print_timing: id 0 | task 703 | n_decoded = 685, tg = 19.42 t/s |
| 1.29.159.935 I slot print_timing: id 0 | task 703 | n_decoded = 742, tg = 19.38 t/s |
| 1.32.178.065 I slot print_timing: id 0 | task 703 | n_decoded = 799, tg = 19.35 t/s |
| 1.35.195.960 I slot print_timing: id 0 | task 703 | n_decoded = 857, tg = 19.34 t/s |
| 1.38.207.311 I slot print_timing: id 0 | task 703 | n_decoded = 915, tg = 19.33 t/s |
| 1.41.248.972 I slot print_timing: id 0 | task 703 | n_decoded = 975, tg = 19.36 t/s |
| 1.44.250.646 I slot print_timing: id 0 | task 703 | n_decoded = 1032, tg = 19.34 t/s |
| 1.47.258.585 I slot print_timing: id 0 | task 703 | n_decoded = 1091, tg = 19.35 t/s |
| 1.50.269.814 I slot print_timing: id 0 | task 703 | n_decoded = 1149, tg = 19.35 t/s |
| 1.53.292.304 I slot print_timing: id 0 | task 703 | n_decoded = 1207, tg = 19.34 t/s |
| 1.56.303.239 I slot print_timing: id 0 | task 703 | n_decoded = 1264, tg = 19.32 t/s |
| 1.59.332.058 I slot print_timing: id 0 | task 703 | n_decoded = 1322, tg = 19.31 t/s |
| 2.02.343.158 I slot print_timing: id 0 | task 703 | n_decoded = 1380, tg = 19.31 t/s |
| 2.05.374.479 I slot print_timing: id 0 | task 703 | n_decoded = 1438, tg = 19.30 t/s |
| 2.08.384.998 I slot print_timing: id 0 | task 703 | n_decoded = 1491, tg = 19.24 t/s |
| 2.11.391.224 I slot print_timing: id 0 | task 703 | n_decoded = 1553, tg = 19.29 t/s |
| 2.14.433.409 I slot print_timing: id 0 | task 703 | n_decoded = 1611, tg = 19.28 t/s |
| 2.17.468.032 I slot print_timing: id 0 | task 703 | n_decoded = 1670, tg = 19.29 t/s |
| 2.20.506.309 I slot print_timing: id 0 | task 703 | n_decoded = 1726, tg = 19.26 t/s |
| 2.23.681.598 I slot print_timing: id 0 | task 703 | n_decoded = 1787, tg = 19.26 t/s |
| 2.26.689.916 I slot print_timing: id 0 | task 703 | n_decoded = 1845, tg = 19.26 t/s |
| 2.29.711.028 I slot print_timing: id 0 | task 703 | n_decoded = 1903, tg = 19.25 t/s |
| 2.32.722.621 I slot print_timing: id 0 | task 703 | n_decoded = 1961, tg = 19.25 t/s |
| 2.35.724.066 I slot print_timing: id 0 | task 703 | n_decoded = 2019, tg = 19.26 t/s |
| 2.38.728.861 I slot print_timing: id 0 | task 703 | n_decoded = 2076, tg = 19.25 t/s |
| 2.41.770.411 I slot print_timing: id 0 | task 703 | n_decoded = 2132, tg = 19.23 t/s |
| 2.44.771.588 I slot print_timing: id 0 | task 703 | n_decoded = 2190, tg = 19.23 t/s |
| 2.47.813.359 I slot print_timing: id 0 | task 703 | n_decoded = 2249, tg = 19.23 t/s |
| 2.50.821.356 I slot print_timing: id 0 | task 703 | n_decoded = 2304, tg = 19.21 t/s |
| 2.53.860.042 I slot print_timing: id 0 | task 703 | n_decoded = 2361, tg = 19.20 t/s |
| 2.56.868.026 I slot print_timing: id 0 | task 703 | n_decoded = 2419, tg = 19.20 t/s |
| 2.59.880.086 I slot print_timing: id 0 | task 703 | n_decoded = 2482, tg = 19.24 t/s |
| 3.02.891.378 I slot print_timing: id 0 | task 703 | n_decoded = 2539, tg = 19.23 t/s |
| 3.05.929.409 I slot print_timing: id 0 | task 703 | n_decoded = 2596, tg = 19.22 t/s |
| 3.08.941.578 I slot print_timing: id 0 | task 703 | n_decoded = 2657, tg = 19.24 t/s |
| 3.10.459.555 I slot print_timing: id 0 | task 703 | prompt eval time = 220.91 ms / 107 tokens ( 2.06 ms per token, 484.35 tokens per second) |
| 3.10.459.561 I slot print_timing: id 0 | task 703 | eval time = 139582.10 ms / 2688 tokens ( 51.93 ms per token, 19.26 tokens per second) |
| 3.10.459.562 I slot print_timing: id 0 | task 703 | total time = 139803.01 ms / 2795 tokens |
| 3.10.459.563 I slot print_timing: id 0 | task 703 | graphs reused = 3359 |
| 3.10.459.593 I slot release: id 0 | task 703 | stop processing: n_tokens = 2794, truncated = 0 |
| 3.10.459.617 I srv update_slots: all slots are idle |
| 4.27.768.964 I srv params_from_: Chat format: peg-native |
| 4.27.769.159 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 17090423461 |
| 4.27.769.164 I srv get_availabl: updating prompt cache |
| 4.27.769.292 W srv prompt_save: - saving prompt with length 2794, total state size = 242.449 MiB (draft: 0.000 MiB) |
| 4.28.096.063 I srv load: - looking for better prompt, base f_keep = 0.000, sim = 0.015 |
| 4.28.096.069 I srv load: - found better prompt with f_keep = 0.753, sim = 0.866 |
| 4.28.148.499 I srv update: - cache state: 2 prompts, 709.899 MiB (limits: 8192.000 MiB, 16384 tokens, 38692 est) |
| 4.28.148.506 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.28.148.507 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.28.148.509 I srv get_availabl: prompt cache update took 379.34 ms |
| 4.28.148.626 I slot launch_slot_: id 0 | task 3394 | processing task, is_child = 0 |
| 4.28.148.640 W slot update_slots: id 0 | task 3394 | erased invalidated context checkpoint (pos_min = 66, pos_max = 66, n_tokens = 67, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.28.278.642 I slot create_check: id 0 | task 3394 | created context checkpoint 1 of 32 (pos_min = 62, pos_max = 62, n_tokens = 63, size = 149.626 MiB) |
| 4.28.763.959 I slot print_timing: id 0 | task 3394 | prompt eval time = 182.20 ms / 67 tokens ( 2.72 ms per token, 367.73 tokens per second) |
| 4.28.763.967 I slot print_timing: id 0 | task 3394 | eval time = 433.12 ms / 7 tokens ( 61.87 ms per token, 16.16 tokens per second) |
| 4.28.763.967 I slot print_timing: id 0 | task 3394 | total time = 615.31 ms / 74 tokens |
| 4.28.763.968 I slot print_timing: id 0 | task 3394 | graphs reused = 3364 |
| 4.28.764.000 I slot release: id 0 | task 3394 | stop processing: n_tokens = 73, truncated = 0 |
| 4.28.764.011 I srv update_slots: all slots are idle |
| 4.28.787.437 I srv params_from_: Chat format: peg-native |
| 4.28.787.643 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.238 (> 0.100 thold), f_keep = 0.205 |
| 4.28.787.647 I srv get_availabl: updating prompt cache |
| 4.28.787.695 W srv prompt_save: - saving prompt with length 73, total state size = 152.052 MiB (draft: 0.000 MiB) |
| 4.28.981.987 I srv load: - looking for better prompt, base f_keep = 0.205, sim = 0.238 |
| 4.28.981.998 I srv update: - cache state: 3 prompts, 1011.577 MiB (limits: 8192.000 MiB, 16384 tokens, 27744 est) |
| 4.28.981.999 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.28.982.000 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.28.982.000 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.28.982.001 I srv get_availabl: prompt cache update took 194.35 ms |
| 4.28.982.106 I slot launch_slot_: id 0 | task 3403 | processing task, is_child = 0 |
| 4.28.982.119 W slot update_slots: id 0 | task 3403 | erased invalidated context checkpoint (pos_min = 62, pos_max = 62, n_tokens = 63, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.29.104.926 I slot create_check: id 0 | task 3403 | created context checkpoint 1 of 32 (pos_min = 58, pos_max = 58, n_tokens = 59, size = 149.626 MiB) |
| 4.29.511.784 I slot print_timing: id 0 | task 3403 | prompt eval time = 174.34 ms / 63 tokens ( 2.77 ms per token, 361.37 tokens per second) |
| 4.29.511.791 I slot print_timing: id 0 | task 3403 | eval time = 355.32 ms / 9 tokens ( 39.48 ms per token, 25.33 tokens per second) |
| 4.29.511.791 I slot print_timing: id 0 | task 3403 | total time = 529.66 ms / 72 tokens |
| 4.29.511.793 I slot print_timing: id 0 | task 3403 | graphs reused = 3371 |
| 4.29.511.821 I slot release: id 0 | task 3403 | stop processing: n_tokens = 71, truncated = 0 |
| 4.29.511.832 I srv update_slots: all slots are idle |
| 4.29.733.303 I srv params_from_: Chat format: peg-native |
| 4.29.733.478 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.227 (> 0.100 thold), f_keep = 0.211 |
| 4.29.733.482 I srv get_availabl: updating prompt cache |
| 4.29.733.525 W srv prompt_save: - saving prompt with length 71, total state size = 151.985 MiB (draft: 0.000 MiB) |
| 4.29.927.094 I srv load: - looking for better prompt, base f_keep = 0.211, sim = 0.227 |
| 4.29.927.104 I srv update: - cache state: 4 prompts, 1313.189 MiB (limits: 8192.000 MiB, 16384 tokens, 21815 est) |
| 4.29.927.105 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.29.927.106 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.29.927.106 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.29.927.107 I srv update: - prompt 0x641bbe048ce0: 71 tokens, checkpoints: 1, 301.611 MiB |
| 4.29.927.108 I srv get_availabl: prompt cache update took 193.63 ms |
| 4.29.927.220 I slot launch_slot_: id 0 | task 3414 | processing task, is_child = 0 |
| 4.29.927.233 W slot update_slots: id 0 | task 3414 | erased invalidated context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.30.049.690 I slot create_check: id 0 | task 3414 | created context checkpoint 1 of 32 (pos_min = 61, pos_max = 61, n_tokens = 62, size = 149.626 MiB) |
| 4.30.674.903 I slot print_timing: id 0 | task 3414 | prompt eval time = 173.98 ms / 66 tokens ( 2.64 ms per token, 379.36 tokens per second) |
| 4.30.674.911 I slot print_timing: id 0 | task 3414 | eval time = 573.68 ms / 10 tokens ( 57.37 ms per token, 17.43 tokens per second) |
| 4.30.674.913 I slot print_timing: id 0 | task 3414 | total time = 747.66 ms / 76 tokens |
| 4.30.674.914 I slot print_timing: id 0 | task 3414 | graphs reused = 3379 |
| 4.30.674.961 I slot release: id 0 | task 3414 | stop processing: n_tokens = 75, truncated = 0 |
| 4.30.674.980 I srv update_slots: all slots are idle |
| 4.30.707.104 I srv params_from_: Chat format: peg-native |
| 4.30.707.355 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 17170638830 |
| 4.30.707.358 I srv get_availabl: updating prompt cache |
| 4.30.707.402 W srv prompt_save: - saving prompt with length 75, total state size = 152.118 MiB (draft: 0.000 MiB) |
| 4.30.900.123 I srv load: - looking for better prompt, base f_keep = 0.040, sim = 0.036 |
| 4.30.900.141 I srv update: - cache state: 5 prompts, 1614.933 MiB (limits: 8192.000 MiB, 16384 tokens, 18119 est) |
| 4.30.900.143 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.30.900.148 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.30.900.148 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.30.900.149 I srv update: - prompt 0x641bbe048ce0: 71 tokens, checkpoints: 1, 301.611 MiB |
| 4.30.900.150 I srv update: - prompt 0x641bbd1fe240: 75 tokens, checkpoints: 1, 301.744 MiB |
| 4.30.900.151 I srv get_availabl: prompt cache update took 192.79 ms |
| 4.30.900.255 I slot launch_slot_: id 0 | task 3426 | processing task, is_child = 0 |
| 4.30.900.267 W slot update_slots: id 0 | task 3426 | erased invalidated context checkpoint (pos_min = 61, pos_max = 61, n_tokens = 62, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.31.031.384 I slot create_check: id 0 | task 3426 | created context checkpoint 1 of 32 (pos_min = 78, pos_max = 78, n_tokens = 79, size = 149.626 MiB) |
| 4.31.990.125 I slot print_timing: id 0 | task 3426 | prompt eval time = 182.65 ms / 83 tokens ( 2.20 ms per token, 454.42 tokens per second) |
| 4.31.990.131 I slot print_timing: id 0 | task 3426 | eval time = 907.20 ms / 18 tokens ( 50.40 ms per token, 19.84 tokens per second) |
| 4.31.990.139 I slot print_timing: id 0 | task 3426 | total time = 1089.85 ms / 101 tokens |
| 4.31.990.140 I slot print_timing: id 0 | task 3426 | graphs reused = 3395 |
| 4.31.990.170 I slot release: id 0 | task 3426 | stop processing: n_tokens = 100, truncated = 0 |
| 4.31.990.184 I srv update_slots: all slots are idle |
| 4.32.022.880 I srv params_from_: Chat format: peg-native |
| 4.32.023.113 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 17171954039 |
| 4.32.023.116 I srv get_availabl: updating prompt cache |
| 4.32.023.165 W srv prompt_save: - saving prompt with length 100, total state size = 152.949 MiB (draft: 0.000 MiB) |
| 4.32.217.019 I srv load: - looking for better prompt, base f_keep = 0.030, sim = 0.046 |
| 4.32.217.028 I srv update: - cache state: 6 prompts, 1917.508 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 4.32.217.029 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.32.217.030 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.32.217.030 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.32.217.031 I srv update: - prompt 0x641bbe048ce0: 71 tokens, checkpoints: 1, 301.611 MiB |
| 4.32.217.032 I srv update: - prompt 0x641bbd1fe240: 75 tokens, checkpoints: 1, 301.744 MiB |
| 4.32.217.032 I srv update: - prompt 0x641bbdd38470: 100 tokens, checkpoints: 1, 302.575 MiB |
| 4.32.217.033 I srv get_availabl: prompt cache update took 193.92 ms |
| 4.32.217.114 I slot launch_slot_: id 0 | task 3446 | processing task, is_child = 0 |
| 4.32.217.120 W slot update_slots: id 0 | task 3446 | erased invalidated context checkpoint (pos_min = 78, pos_max = 78, n_tokens = 79, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.32.340.654 I slot create_check: id 0 | task 3446 | created context checkpoint 1 of 32 (pos_min = 60, pos_max = 60, n_tokens = 61, size = 149.626 MiB) |
| 4.33.017.750 I slot print_timing: id 0 | task 3446 | prompt eval time = 175.05 ms / 65 tokens ( 2.69 ms per token, 371.33 tokens per second) |
| 4.33.017.757 I slot print_timing: id 0 | task 3446 | eval time = 625.58 ms / 12 tokens ( 52.13 ms per token, 19.18 tokens per second) |
| 4.33.017.758 I slot print_timing: id 0 | task 3446 | total time = 800.62 ms / 77 tokens |
| 4.33.017.758 I slot print_timing: id 0 | task 3446 | graphs reused = 3405 |
| 4.33.017.789 I slot release: id 0 | task 3446 | stop processing: n_tokens = 76, truncated = 0 |
| 4.33.017.800 I srv update_slots: all slots are idle |
| 4.33.042.618 I srv params_from_: Chat format: peg-native |
| 4.33.043.190 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 17172981657 |
| 4.33.043.193 I srv get_availabl: updating prompt cache |
| 4.33.043.221 W srv prompt_save: - saving prompt with length 76, total state size = 152.151 MiB (draft: 0.000 MiB) |
| 4.33.236.474 I srv load: - looking for better prompt, base f_keep = 0.039, sim = 0.039 |
| 4.33.236.481 I srv load: - found better prompt with f_keep = 0.340, sim = 0.442 |
| 4.33.283.404 I srv update: - cache state: 6 prompts, 1916.710 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 4.33.283.411 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.33.283.412 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.33.283.412 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.33.283.413 I srv update: - prompt 0x641bbe048ce0: 71 tokens, checkpoints: 1, 301.611 MiB |
| 4.33.283.414 I srv update: - prompt 0x641bbd1fe240: 75 tokens, checkpoints: 1, 301.744 MiB |
| 4.33.283.414 I srv update: - prompt 0x641bbd3a6cd0: 76 tokens, checkpoints: 1, 301.778 MiB |
| 4.33.283.416 I srv get_availabl: prompt cache update took 240.22 ms |
| 4.33.283.528 I slot launch_slot_: id 0 | task 3460 | processing task, is_child = 0 |
| 4.33.283.539 W slot update_slots: id 0 | task 3460 | erased invalidated context checkpoint (pos_min = 78, pos_max = 78, n_tokens = 79, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.33.413.435 I slot create_check: id 0 | task 3460 | created context checkpoint 1 of 32 (pos_min = 72, pos_max = 72, n_tokens = 73, size = 149.626 MiB) |
| 4.34.820.398 I slot print_timing: id 0 | task 3460 | prompt eval time = 181.51 ms / 77 tokens ( 2.36 ms per token, 424.21 tokens per second) |
| 4.34.820.405 I slot print_timing: id 0 | task 3460 | eval time = 1355.34 ms / 24 tokens ( 56.47 ms per token, 17.71 tokens per second) |
| 4.34.820.405 I slot print_timing: id 0 | task 3460 | total time = 1536.85 ms / 101 tokens |
| 4.34.820.406 I slot print_timing: id 0 | task 3460 | graphs reused = 3427 |
| 4.34.820.434 I slot release: id 0 | task 3460 | stop processing: n_tokens = 100, truncated = 0 |
| 4.34.820.445 I srv update_slots: all slots are idle |
| 4.34.853.897 I srv params_from_: Chat format: peg-native |
| 4.34.854.131 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.393 (> 0.100 thold), f_keep = 0.350 |
| 4.34.854.142 I srv get_availabl: updating prompt cache |
| 4.34.854.169 W srv prompt_save: - saving prompt with length 100, total state size = 152.949 MiB (draft: 0.000 MiB) |
| 4.35.050.337 I srv load: - looking for better prompt, base f_keep = 0.350, sim = 0.393 |
| 4.35.050.355 I srv update: - cache state: 7 prompts, 2219.285 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 4.35.050.356 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.35.050.357 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.35.050.358 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.35.050.358 I srv update: - prompt 0x641bbe048ce0: 71 tokens, checkpoints: 1, 301.611 MiB |
| 4.35.050.359 I srv update: - prompt 0x641bbd1fe240: 75 tokens, checkpoints: 1, 301.744 MiB |
| 4.35.050.360 I srv update: - prompt 0x641bbd3a6cd0: 76 tokens, checkpoints: 1, 301.778 MiB |
| 4.35.050.360 I srv update: - prompt 0x641bbdc2f630: 100 tokens, checkpoints: 1, 302.575 MiB |
| 4.35.050.361 I srv get_availabl: prompt cache update took 196.22 ms |
| 4.35.051.180 I slot launch_slot_: id 0 | task 3486 | processing task, is_child = 0 |
| 4.35.051.191 W slot update_slots: id 0 | task 3486 | erased invalidated context checkpoint (pos_min = 72, pos_max = 72, n_tokens = 73, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.35.184.701 I slot create_check: id 0 | task 3486 | created context checkpoint 1 of 32 (pos_min = 84, pos_max = 84, n_tokens = 85, size = 149.626 MiB) |
| 4.37.848.477 I slot print_timing: id 0 | task 3486 | prompt eval time = 185.02 ms / 89 tokens ( 2.08 ms per token, 481.03 tokens per second) |
| 4.37.848.483 I slot print_timing: id 0 | task 3486 | eval time = 2612.26 ms / 50 tokens ( 52.25 ms per token, 19.14 tokens per second) |
| 4.37.848.484 I slot print_timing: id 0 | task 3486 | total time = 2797.28 ms / 139 tokens |
| 4.37.848.485 I slot print_timing: id 0 | task 3486 | graphs reused = 3475 |
| 4.37.848.518 I slot release: id 0 | task 3486 | stop processing: n_tokens = 138, truncated = 0 |
| 4.37.848.531 I srv update_slots: all slots are idle |
| 4.37.885.588 I srv params_from_: Chat format: peg-native |
| 4.37.885.825 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 17177812386 |
| 4.37.885.827 I srv get_availabl: updating prompt cache |
| 4.37.885.863 W srv prompt_save: - saving prompt with length 138, total state size = 154.211 MiB (draft: 0.000 MiB) |
| 4.38.079.413 I srv load: - looking for better prompt, base f_keep = 0.022, sim = 0.050 |
| 4.38.079.429 I srv update: - cache state: 8 prompts, 2523.123 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 4.38.079.430 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.38.079.431 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.38.079.431 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.38.079.432 I srv update: - prompt 0x641bbe048ce0: 71 tokens, checkpoints: 1, 301.611 MiB |
| 4.38.079.433 I srv update: - prompt 0x641bbd1fe240: 75 tokens, checkpoints: 1, 301.744 MiB |
| 4.38.079.434 I srv update: - prompt 0x641bbd3a6cd0: 76 tokens, checkpoints: 1, 301.778 MiB |
| 4.38.079.434 I srv update: - prompt 0x641bbdc2f630: 100 tokens, checkpoints: 1, 302.575 MiB |
| 4.38.079.435 I srv update: - prompt 0x641bbdd3e880: 138 tokens, checkpoints: 1, 303.837 MiB |
| 4.38.079.436 I srv get_availabl: prompt cache update took 193.61 ms |
| 4.38.079.543 I slot launch_slot_: id 0 | task 3538 | processing task, is_child = 0 |
| 4.38.079.555 W slot update_slots: id 0 | task 3538 | erased invalidated context checkpoint (pos_min = 84, pos_max = 84, n_tokens = 85, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.38.198.034 I slot create_check: id 0 | task 3538 | created context checkpoint 1 of 32 (pos_min = 55, pos_max = 55, n_tokens = 56, size = 149.626 MiB) |
| 4.38.761.726 I slot print_timing: id 0 | task 3538 | prompt eval time = 169.96 ms / 60 tokens ( 2.83 ms per token, 353.02 tokens per second) |
| 4.38.761.733 I slot print_timing: id 0 | task 3538 | eval time = 512.20 ms / 9 tokens ( 56.91 ms per token, 17.57 tokens per second) |
| 4.38.761.734 I slot print_timing: id 0 | task 3538 | total time = 682.16 ms / 69 tokens |
| 4.38.761.735 I slot print_timing: id 0 | task 3538 | graphs reused = 3482 |
| 4.38.761.761 I slot release: id 0 | task 3538 | stop processing: n_tokens = 68, truncated = 0 |
| 4.38.761.772 I srv update_slots: all slots are idle |
| 4.38.795.754 I srv params_from_: Chat format: peg-native |
| 4.38.795.990 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.183 (> 0.100 thold), f_keep = 0.221 |
| 4.38.795.993 I srv get_availabl: updating prompt cache |
| 4.38.796.034 W srv prompt_save: - saving prompt with length 68, total state size = 151.886 MiB (draft: 0.000 MiB) |
| 4.38.988.585 I srv load: - looking for better prompt, base f_keep = 0.221, sim = 0.183 |
| 4.38.988.601 I srv update: - cache state: 9 prompts, 2824.634 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 4.38.988.602 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.38.988.603 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.38.988.604 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.38.988.604 I srv update: - prompt 0x641bbe048ce0: 71 tokens, checkpoints: 1, 301.611 MiB |
| 4.38.988.605 I srv update: - prompt 0x641bbd1fe240: 75 tokens, checkpoints: 1, 301.744 MiB |
| 4.38.988.606 I srv update: - prompt 0x641bbd3a6cd0: 76 tokens, checkpoints: 1, 301.778 MiB |
| 4.38.988.606 I srv update: - prompt 0x641bbdc2f630: 100 tokens, checkpoints: 1, 302.575 MiB |
| 4.38.988.607 I srv update: - prompt 0x641bbdd3e880: 138 tokens, checkpoints: 1, 303.837 MiB |
| 4.38.988.607 I srv update: - prompt 0x641bbe301fd0: 68 tokens, checkpoints: 1, 301.512 MiB |
| 4.38.988.609 I srv get_availabl: prompt cache update took 192.62 ms |
| 4.38.988.711 I slot launch_slot_: id 0 | task 3549 | processing task, is_child = 0 |
| 4.38.988.722 W slot update_slots: id 0 | task 3549 | erased invalidated context checkpoint (pos_min = 55, pos_max = 55, n_tokens = 56, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.39.117.754 I slot create_check: id 0 | task 3549 | created context checkpoint 1 of 32 (pos_min = 77, pos_max = 77, n_tokens = 78, size = 149.626 MiB) |
| 4.39.986.736 I slot print_timing: id 0 | task 3549 | prompt eval time = 180.65 ms / 82 tokens ( 2.20 ms per token, 453.91 tokens per second) |
| 4.39.986.743 I slot print_timing: id 0 | task 3549 | eval time = 817.36 ms / 16 tokens ( 51.08 ms per token, 19.58 tokens per second) |
| 4.39.986.744 I slot print_timing: id 0 | task 3549 | total time = 998.01 ms / 98 tokens |
| 4.39.986.745 I slot print_timing: id 0 | task 3549 | graphs reused = 3496 |
| 4.39.986.779 I slot release: id 0 | task 3549 | stop processing: n_tokens = 97, truncated = 0 |
| 4.39.986.791 I srv update_slots: all slots are idle |
| 4.40.019.712 I srv params_from_: Chat format: peg-native |
| 4.40.019.941 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 17179950647 |
| 4.40.019.943 I srv get_availabl: updating prompt cache |
| 4.40.019.972 W srv prompt_save: - saving prompt with length 97, total state size = 152.849 MiB (draft: 0.000 MiB) |
| 4.40.224.011 I srv load: - looking for better prompt, base f_keep = 0.031, sim = 0.033 |
| 4.40.224.019 I srv load: - found better prompt with f_keep = 0.340, sim = 0.374 |
| 4.40.271.448 I srv update: - cache state: 9 prompts, 2824.535 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) |
| 4.40.271.455 I srv update: - prompt 0x641bbde13e30: 559 tokens, checkpoints: 1, 317.824 MiB |
| 4.40.271.456 I srv update: - prompt 0x641bbd8d57e0: 2794 tokens, checkpoints: 1, 392.075 MiB |
| 4.40.271.457 I srv update: - prompt 0x641bbde13340: 73 tokens, checkpoints: 1, 301.678 MiB |
| 4.40.271.457 I srv update: - prompt 0x641bbe048ce0: 71 tokens, checkpoints: 1, 301.611 MiB |
| 4.40.271.458 I srv update: - prompt 0x641bbd1fe240: 75 tokens, checkpoints: 1, 301.744 MiB |
| 4.40.271.459 I srv update: - prompt 0x641bbd3a6cd0: 76 tokens, checkpoints: 1, 301.778 MiB |
| 4.40.271.459 I srv update: - prompt 0x641bbdd3e880: 138 tokens, checkpoints: 1, 303.837 MiB |
| 4.40.271.460 I srv update: - prompt 0x641bbe301fd0: 68 tokens, checkpoints: 1, 301.512 MiB |
| 4.40.271.460 I srv update: - prompt 0x641bc05be990: 97 tokens, checkpoints: 1, 302.475 MiB |
| 4.40.271.462 I srv get_availabl: prompt cache update took 251.52 ms |
| 4.40.271.575 I slot launch_slot_: id 0 | task 3567 | processing task, is_child = 0 |
| 4.40.271.588 W slot update_slots: id 0 | task 3567 | erased invalidated context checkpoint (pos_min = 72, pos_max = 72, n_tokens = 73, n_swa = 0, pos_next = 0, size = 149.626 MiB) |
| 4.40.408.064 I slot create_check: id 0 | task 3567 | created context checkpoint 1 of 32 (pos_min = 86, pos_max = 86, n_tokens = 87, size = 149.626 MiB) |
| 4.41.759.500 I slot print_timing: id 0 | task 3567 | prompt eval time = 188.17 ms / 91 tokens ( 2.07 ms per token, 483.61 tokens per second) |
| 4.41.759.506 I slot print_timing: id 0 | task 3567 | eval time = 1299.73 ms / 23 tokens ( 56.51 ms per token, 17.70 tokens per second) |
| 4.41.759.506 I slot print_timing: id 0 | task 3567 | total time = 1487.90 ms / 114 tokens |
| 4.41.759.507 I slot print_timing: id 0 | task 3567 | graphs reused = 3517 |
| 4.41.759.536 I slot release: id 0 | task 3567 | stop processing: n_tokens = 113, truncated = 0 |
| 4.41.759.547 I srv update_slots: all slots are idle |
| 5.23.844.598 I srv operator(): operator(): cleaning up before exit... |
|
|
