Simon Willison’s Weblog

13th March 2023 - Link Blog

Int-4 LLaMa is not enough - Int-3 and beyond (via) The Nolano team are experimenting with reducing the size of the LLaMA models even further than the 4bit quantization popularized by llama.cpp.

Posted 13th March 2023 at 11:55 pm

Recent articles

A new feature for my blog, built using my voice - 9th October 2026
Claude Haiku 5.5 - 7th October 2026
We're going to need default hard budget caps on pretty much everything - 3rd October 2026
OpenAI DevDay 2026 live blog - 29th September 2026

This is a link post by Simon Willison, posted on 13th March 2023.

ai 2,274 generative-ai 2,016 llama 81 local-llms 165 llms 1,982

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe