Data error in KM scaling law
Author: LJHzjuCreated Mar 6, 2024Updated Mar 10, 2024
Regarding the KM scaling law in Chapter 2.1 of your paper, the model size range should be 768\~1.5B, not 7.68B\~1.5B, according to Figure 1(c) in the original OpenAI paper.
Source: RUCAIBox/LLMSurvey