#186·TinyLlama

Llama 3

Author: cdukCreated May 22, 2024Updated Jul 15, 2024

Given that we have only Llama 3 70B and 8B, it would be useful to have a Tiny Llama based on the Llama 3 tokenizer so that we can use it as a drafting model for speculative decoding.

Are there plans to create a Llama 3 version?