Llama 3
Author: cdukCreated May 22, 2024Updated Jul 15, 2024
Given that we have only Llama 3 70B and 8B, it would be useful to have a Tiny Llama based on the Llama 3 tokenizer so that we can use it as a drafting model for speculative decoding.
Are there plans to create a Llama 3 version?
Source: jzhang38/TinyLlama