Simon Willison’s Weblog

Int-4 LLaMa is not enough - Int-3 and beyond (via) The Nolano team are experimenting with reducing the size of the LLaMA models even further than the 4bit quantization popularized by llama.cpp.

Posted 13th March 2023 at 11:55 pm

Recent articles

Vibe engineering - 7th October 2025
OpenAI DevDay 2025 live blog - 6th October 2025
Embracing the parallel coding agent lifestyle - 5th October 2025

ai 1605 generative-ai 1414 llama 77 local-llms 140 llms 1383

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe