Simon Willison on llm

Datasette Cloud is now a significant step closer to general availability. The Datasette 1.03 alpha release is out, with a mostly finalized JSON format for 1.0. Plus new plugins for LLM and sqlite-utils and a flurry of things I’ve learned.

[... 1,690 words]

11:19 pm / 16th August 2023 / weeknotes, sqlite-utils, llm, datasette-cloud, plugins, datasette, projects

Running my own LLM (via) Nelson Minar describes running LLMs on his own computer using my LLM tool and llm-gpt4all plugin, plus some notes on trying out some of the other plugins.

# 16th August 2023, 10:42 pm / llm, nelson-minar, local-llms, llms

Release llm-mlc 0.5 — LLM plugin for running models using MLC

15th Aug 2023, 4:22 am · llm

Release llm-mlc 0.4 — LLM plugin for running models using MLC

14th Aug 2023, 12:21 am · llm

Release llm 0.7 — Access large language models from the command-line

12th Aug 2023, 4:41 pm · llm

llm-mlc (via) My latest plugin for LLM adds support for models that use the MLC Python library—which is the first library I’ve managed to get to run Llama 2 with GPU acceleration on my M2 Mac laptop.

# 12th August 2023, 5:33 am / llm, projects, generative-ai, mlc, ai, llms, plugins

Release llm-mlc 0.3 — LLM plugin for running models using MLC

12th Aug 2023, 5:26 am · llm

Release llm-mlc 0.2 — LLM plugin for running models using MLC

12th Aug 2023, 4:52 am · llm

Release llm-mlc 0.1a0 — LLM plugin for running models using MLC

12th Aug 2023, 2:07 am · llm

Weeknotes: Plugins for LLM, sqlite-utils and Datasette

The principle theme for the past few weeks has been plugins.

[... 1,203 words]

12:32 am / 5th August 2023 / llm, projects, datasette, plugins, sqlite-utils, my-talks, weeknotes, cli

Catching up on the weird world of LLMs

I gave a talk on Sunday at North Bay Python where I attempted to summarize the last few years of development in the space of LLMs—Large Language Models, the technology behind tools like ChatGPT, Google Bard and Llama 2.

[... 10,489 words]

2:51 pm / 3rd August 2023 / llm, ethics, generative-ai, python, my-talks, ai, llms, openai, chatgpt, anthropic, claude, annotated-talks, code-interpreter, ai-ethics, coding-agents

Run Llama 2 on your own Mac using LLM and Homebrew

Llama 2 is the latest commercially usable openly licensed Large Language Model, released by Meta AI a few weeks ago. I just released a new plugin for my LLM utility that adds support for Llama 2 and many other llama-cpp compatible models.

[... 1,423 words]

6:56 pm / 1st August 2023 / llm, plugins, llama, ai, local-llms, llms, macos, generative-ai, projects, homebrew, llama-cpp

Release llm-llama-cpp 0.1a0 — LLM plugin for running models using llama.cpp

1st Aug 2023, 5:42 pm · llm

Release llm-gpt4all 0.1.1 — Plugin for LLM adding support for the GPT4All collection of models

25th Jul 2023, 9:28 pm · llm

LLM can now be installed directly from Homebrew (via) I spent a bunch of time on this at the weekend: my LLM tool for interacting with large language models from the terminal has now been accepted into Homebrew core, and can be installed directly using “brew install llm”. I was previously running my own separate tap, but having it in core means that it benefits from Homebrew’s impressive set of build systems—each release of LLM now has Bottles created for it automatically across a range of platforms, so “brew install llm” should quickly download binary assets rather than spending several minutes installing dependencies the slow way.

# 24th July 2023, 5:16 pm / llm, generative-ai, projects, homebrew, ai, llms