[BUG: 发生故障] LLaMA.cpp 后端上的并行推理不起作用。

0.01.067.790 I srv init: init: chat template, thinking = 0 0.01.067.818 I srv llama_server: model loaded 0.01.067.821 I srv llama_server: listening on http://0.0.0.0:8081 0.01.067.836 I srv update_slots: all slots are idle 0.13.230.185 I srv operator (): chat format: peg-native 0.13.230.311 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1 0.13.230.312 I srv get_availabl: updating prompt cache 0.13.230.323 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 0.13.230.331 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 50176 tokens, 8589934592 est) 0.13.230.333 I srv get_availabl: prompt cache update took 0.02 ms 0.13.239.230 I slot launch_slot_: id 3 | task -1 | sampler chain: logits -> ?penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> top-p -> min-p -> ?xtc -> temp-ext -> dist 0.13.239.259 I slot launch_slot_: id 3 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.000, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 12544 top_k = 40, top_p = 0.100, min_p = 0.050, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 0.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 0.13.239.264 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0 0.13.239.265 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.13.239.266 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.13.239.267 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.13.239.284 I slot operator (): id 3 | task 0 | new prompt, n_ctx_slot = 12544, n_keep = 0, task.n_tokens = 3364 0.13.239.290 I slot operator (): id 3 | task 0 | cached n_tokens = 0, memory_seq_rm [0, end) 0.13.246.691 I slot operator (): id 3 | task 0 | cached n_tokens = 7, memory_seq_rm [7, end) 0.13.246.768 I slot process_mtmd: id 3 | task 0 | encoding mtmd batch from idx = 7, n_chunks = 1 0.19.628.115 I decoding image batch 1/2, n_tokens_batch = 2048 0.19.630.655 W find_slot: non-consecutive token position 7 after 6 for sequence 3 with 512 new tokens 0.19.630.662 W find_slot: non-consecutive token position 7 after 7 for sequence 3 with 512 new tokens 0.19.630.663 W find_slot: non-consecutive token position 7 after 7 for sequence 3 with 512 new tokens 0.19.630.664 W find_slot: non-consecutive token position