Qwen3

工具介绍

Qwen3由Qwen团队所开发的大语言模型系列,阿里巴巴克云.

核心特点

• •Quickstart: the basic usages and demonstrations;
• •Inference: the guidance for the inference with Transformers, including batch inference, streaming, etc.;
• •Run Locally: the instructions for running LLM locally on CPU and GPU, with frameworks like llama.cpp, Ollama, and LM Studio;
• •Deployment: the demonstration of how to deploy Qwen for large-scale inference with frameworks like SGLang, vLLM, TGI, etc.;
• •Quantization: the practice of quantizing LLMs with GPTQ, AWQ, as well as the guidance for how to make high-quality quantized GGUF files;
• •Training: the instructions for post-training, including SFT and RLHF (TODO) with frameworks like Axolotl, LLaMA-Factory, etc.
• •Framework: the usage of Qwen with frameworks for application, e.g., RAG, Agent, etc.
• •Significant improvements in general capabilities, including instruction following, logical reasoning, text comprehension, mathematics, science, coding and tool usage.
• •Substantial gains in long-tail knowledge coverage across multiple languages.
• •Markedly better alignment with user preferences in subjective and open-ended tasks, enabling more helpful responses and higher-quality text generation.