Baike.dev
All toolsAI codingTrendingOpen sourceNewsSubmit
Log in
Back to tool/Back to issues
#85·streaming-llm

【question】Does streaming-llm focus on accelerating decoding stage? How about the prefilling stage?

Author: Code24ManCreated Jul 31, 2024Updated Jul 31, 2024

—

Source: mit-han-lab/streaming-llm

View original on GitHubView discussion on GitHub