minGPT

工具介绍

OpenAI GPT(Generative Pretrained Transformer)培训的最小PyTorch重用

• #131

  how to build a model and interact with it like chatgpt?

  更新于 2026年8月5日
• #134

  GPT-2 implementation problem

  更新于 2026年8月5日
• #120

  AssertionError when run generate.ipynb with default parameter

  更新于 2026年5月23日
• #149

  Rasssssfffatay

  更新于 2025年6月30日
• #148

  Hikceyi

  更新于 2025年6月30日
• #136

  We collect more than 60 open source software for CAX and want to train miniGP to be the AI assistant.

  更新于 2025年3月20日

核心特点

• •projects/adder trains a GPT from scratch to add numbers (inspired by the addition section in the GPT-3 paper)
• •projects/chargpt trains a GPT to be a character-level language model on some input text file
• •demo.ipynb shows a minimal usage of the GPT and Trainer in a notebook format on a simple sorting example
• •generate.ipynb shows how one can load a pretrained GPT2 and generate text given some prompt
• •add gpt-2 finetuning demo on arbitrary given text file
• •add dialog agent demo
• •better docs of outcomes for existing projects (adder, chargpt)
• •add mixed precision and related training scaling goodies
• •distributed training support
• •reproduce some benchmarks in projects/, e.g. text8 or other language modeling