base_eval.py: hellaswag 在小型模型上逐渐变慢并泄露内存 (Mac Studio)
作者: pkrefta创建于 2026年1月9日更新于 2026年6月3日
标签performance
I'm running `base_eval.py` on a very small model trained with `base_train.py`. Evaluation starts normally, but on the **hellaswag** task each example becomes slower and slower, memory usage grows continuously, and the script will take massive amount of time to finish. Other tasks finish in minutes, but hellaswag runs for hours.
内容来源: karpathy/nanochat