Simon Willison’s Weblog

Subscribe

Entries tagged datasettelite, llms in 2023

Filters: Type: entry × Year: 2023 × datasettelite × llms × Sorted by date


Weeknotes: Parquet in Datasette Lite, various talks, more LLM hacking

I’ve fallen a bit behind on my weeknotes. Here’s a catchup for the last few weeks.

[... 769 words]

9:14 pm / 4th June 2023 / projects, speaking, tutorials, datasette, parquet, weeknotes, datasettelite, llms

What’s in the RedPajama-Data-1T LLM training set

RedPajama is “a project to create leading open-source models, starts by reproducing LLaMA training dataset of over 1.2 trillion tokens”. It’s a collaboration between Together, Ontocord.ai, ETH DS3Lab, Stanford CRFM, Hazy Research, and MILA Québec AI Institute.

[... 1077 words]

6:57 pm / 17th April 2023 / ai, datasette, datasettelite, generativeai, llama, homebrewllms, llms, aiassistedprogramming, redpajama

Types

Years

Months

Tags