Simon Willison’s Weblog

Announcing 1-bit Bonsai. PrismML is a newly out-of-stealth AI lab with a focus on researching "can we massively multiply intelligence in models without increasing their size or complexity?".

Their first model release is a model called Bonsai, and it's very small indeed: it comes in 1.7B, 4B and 8B parameter sizes but uses 1 bit parameters. Here are the sizes of the resulting models on Hugging Face: