Items tagged llama in Jun, 2023
Filters: Year: 2023 × Month: Jun × llama × Sorted by date
1 result
Llama encoder and decoder. I forked my GPT tokenizer Observable notebook to create a similar tool for exploring the tokenization scheme used by the Llama family of LLMs, using the new llama-tokenizer-js JavaScript library. # 13th June 2023, 10:37 pm