How to evaluate ppl?

Author: Jiawei-YangCreated Mar 13, 2024Updated May 6, 2025

Hi, thanks for your amazing work!

I noticed that there's an evaluation script for perplexity. I wonder how to replicate the results in tables 1 and 2. Are there any instructions for this?

Source: mit-han-lab/streaming-llm