Simon Willison’s Weblog

12th August 2023 - Link Blog

llm-mlc (via) My latest plugin for LLM adds support for models that use the MLC Python library—which is the first library I’ve managed to get to run Llama 2 with GPU acceleration on my M2 Mac laptop.

Posted 12th August 2023 at 5:33 am

Recent articles

Notes on Pope Leo XIV's encyclical on AI - 25th May 2026
Datasette Agent - 21st May 2026
Gemini 3.5 Flash: more expensive, but Google plan to use it for everything - 19th May 2026

This is a link post by Simon Willison, posted on 12th August 2023.

plugins 127 projects 531 ai 2034 generative-ai 1799 llms 1765 mlc 10 llm 604

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe