更改日志: `libllama` API
作者: ggerganov创建于 2024年9月3日更新于 2026年9月17日
标签documentationroadmap
Overview This is a list of changes to the public interface of the LLaMA library. Collaborators are encouraged to edit this post in order to reflect important changes to the API that end up merged into the master branch. If you are building a 3rd party project that relies on libllama, it is recommended to follow this issue and check it before upgrading to new versions. See also: - Changelog for LLaMA-server REST API ## Recent API changes (most recent at the top) | version | PR | desc | --- | --- | --- | b11019 | #28993 | Add llama_adapter_lora_init_from_file_ptr b10875 | #28334 | Remove CLI flags --mmap, --mlock, --direct-io in favor for --load-mode flag b10273 | #26524 | Remove n_ctx_train from llama_sampler_init_dry, -1 no longer means full-context for llama_sampler_init_penalties and llama_sampler_init_dry b10258 | #26520 | Move n_vocab from llama_sampler_data to llama_sampler_init_penalties b10242 | #25262 | Added n_vocab to llama_sampler_data b10206 | #26296 | Update llama_model_params - new load_mtp flag b10145 | #26135 | Update load mode API - add LLAMA_LOAD_MODE_MMAP_MLOCK b10105 | #20834 | Deprecate --mmap/mlock/dio flags for --load-mode flag b9460 | #23861 | Update llama_context_params (add n_outputs_max) b8608 | #20346 | Update llama_model_quantize_params b8049 | #19280 | Update llama_*_adapter_lora() API b7672 | #18390 | Memory margin per device for llama_params_fit b7668 | #18166 | Update llama_model_params - new use_direct_io flag b7639 | #18607 | Add llama_model_n_embd_out b7628 | #17004 | Add backend sampling API b7551 | #18374 | Return an enum instead of a boolean to indicate teh result of llama_params_fit b7407 | #16653 | Add flag no_alloc to llama_model_param, no change with llama_model_default_params b6976 | #16928 | Add llama_model_n_embd_inp bTBD | #15665 | Remove llama_sampler_init_softmax() + dist sampler no longer implicitly sorts b6239 | #15472 | Remove llama_kv_self_... API b6157 | #15293 | Add llama_state_seq_..._ext API b5913 | #14363 | Update llama_context_params - add bool kv_unified b5740 | #13037 | Update llama_model_quantize_params b5870 | #14631 | Remove enum llama_vocab_pre_type b5435 | #13653 | Remove llama_kv_cache_view_* API b5429 | #13194 | Update llama_context_params - add bool swa_full b5311 | #13284 | Update llama_context_params - remove logits_all + rearrange flags b5125 | #12511 | Update llama_model_quantize_params b5028 | #11397 | Update llama_model_params b4882 | #12181 | Change llama_kv_cache_... -> llama_kv_self_... b4599 | #9639 | Add llama_sampler_init_grammar_lazy to support lazy grammars w/ trigger words & tokens b4524 | #11016 | Add name parameter to llama_model_chat_template (uses default …
内容来源: ggml-org/llama.cpp