Simon Willison on llm

584 posts tagged “llm”

LLM is my command-line tool for running prompts against Large Language Models.

2024

llmc.sh (via) Adam Montgomery wrote this a neat wrapper around my LLM CLI utility: it adds a “llmc” zsh function which you can ask for shell commands (llmc ’use ripgrep to find files matching otter’) which outputs the command, an explanation of the command and then copies the command to your clipboard for you to paste and execute if it looks like the right thing.

# 16th February 2024, 6:19 pm / llm, llms, ai, generative-ai, zsh, cli

Weeknotes: a Datasette release, an LLM release and a bunch of new plugins

I wrote extensive annotated release notes for Datasette 1.0a8 and LLM 0.13 already. Here’s what else I’ve been up to this past three weeks.

[... 1,074 words]

11:59 pm / 9th February 2024 / shot-scraper, llm, datasette, projects, weeknotes, quickjs, enrichments

llm-sentence-transformers 0.2. I added a new --trust-remote-code option when registering an embedding model, which means LLM can now run embeddings through the new Nomic AI nomic-embed-text-v1 model.

# 4th February 2024, 7:39 pm / llm, embeddings, plugins, projects, ai, transformers, nomic

Release llm-sentence-transformers 0.2 — LLM plugin for embeddings using sentence-transformers

4th Feb 2024, 6:54 pm · llm

llm-embed-onnx. I wrote a new plugin for LLM that acts as a thin wrapper around onnx_embedding_models by Benjamin Anderson, providing access to seven embedding models that can run on the ONNX model framework.

The actual plugin is around 50 lines of code, which makes for a nice example of how thin a plugin wrapper can be that adds new models to my LLM tool.

# 28th January 2024, 10:28 pm / embedding, projects, ai, llm, plugins

Release llm-embed-onnx 0.1 — Run embedding models using ONNX

28th Jan 2024, 10:21 pm · llm

Release llm 0.13.1 — Access large language models from the command-line

27th Jan 2024, 12:28 am · llm

LLM 0.13: The annotated release notes

I just released LLM 0.13, the latest version of my LLM command-line tool for working with Large Language Models—both via APIs and running models locally using plugins.

[... 1,278 words]

11:08 pm / 26th January 2024 / llm, projects, generative-ai, annotated-release-notes, ai, llms, openai

Release llm 0.13 — Access large language models from the command-line

26th Jan 2024, 10:34 pm · llm

Release llm-gpt4all 0.3 — Plugin for LLM adding support for the GPT4All collection of models

24th Jan 2024, 3:17 am · llm

Talking about Open Source LLMs on Oxide and Friends

I recorded an episode of the Oxide and Friends podcast on Monday, talking with Bryan Cantrill and Adam Leventhal about Open Source LLMs.

[... 1,995 words]

9:39 pm / 17th January 2024 / llm, anthropic, claude, ai, podcasts, llms, open-source, generative-ai, whisper, oxide, bryan-cantrill, podcast-appearances

2023

Many options for running Mistral models in your terminal using LLM

Mistral AI is the most exciting AI research lab at the moment. They’ve now released two extremely powerful smaller Large Language Models under an Apache 2 license, and have a third much larger one that’s available via their API.

[... 2,063 words]

6:18 pm / 18th December 2023 / mistral, llm, plugins, projects, generative-ai, ai, llms, llamafile, llama-cpp, openrouter, local-llms, cli

Release llm-mistral 0.2 — LLM plugin providing access to Mistral models using the Mistral API

15th Dec 2023, 5:05 am · mistral, llm

Release llm-mistral 0.1 — LLM plugin providing access to Mistral models using the Mistral API

15th Dec 2023, 4:04 am · llm, mistral

Release llm-anyscale-endpoints 0.4 — LLM plugin for models hosted by Anyscale Endpoints

14th Dec 2023, 4:55 am · llm

Release llm-gemini 0.1a0 — LLM plugin to access Google's Gemini family of models

13th Dec 2023, 8:22 pm · llm, gemini

Release llm-llama-cpp 0.3 — LLM plugin for running models using llama.cpp

9th Dec 2023, 5:48 am · llm

ospeak: a CLI tool for speaking text in the terminal via OpenAI

I attended OpenAI DevDay today, the first OpenAI developer conference. It was a lot. They released a bewildering array of new API tools, which I’m just beginning to wade my way through fully understanding.

[... 1,109 words]

4:54 am / 7th November 2023 / llm, openai, gpt-4, ai, llms, generative-ai, projects, chatgpt, cli

Release llm 0.12 — Access large language models from the command-line

6th Nov 2023, 9:33 pm · llm

Release llm 0.11.2 — Access large language models from the command-line

6th Nov 2023, 8:08 pm · llm

Release llm-anyscale-endpoints 0.3 — LLM plugin for models hosted by Anyscale Endpoints

3rd Nov 2023, 5:24 am · llm

Release llm 0.11.1 — Access large language models from the command-line

1st Nov 2023, 4:31 am · llm

DALL-E 3, GPT4All, PMTiles, sqlite-migrate, datasette-edit-schema

I wrote a lot this week. I also did some fun research into new options for self-hosting vector maps and pushed out several new releases of plugins.

[... 1,362 words]

11:59 pm / 30th October 2023 / projects, sqlite-utils, llm, weeknotes, mapping, overture

Release llm-python 0.1 — "llm python" is a command to run a Python interpreter in the LLM virtual environment

27th Oct 2023, 5:37 am · llm

Execute Jina embeddings with a CLI using llm-embed-jina

Berlin-based Jina AI just released a new family of embedding models, boasting that they are the “world’s first open-source 8K text embedding model” and that they rival OpenAI’s text-embedding-ada-002 in quality.

[... 1,392 words]

3:47 am / 26th October 2023 / llm, plugins, projects, ai, embeddings, jina, cli

Release llm-embed-jina 0.1.2 — Embedding models from Jina AI

26th Oct 2023, 3:03 am · llm

Release llm-embed-jina 0.1.1 — Embedding models from Jina AI

26th Oct 2023, 1:26 am · llm

Release llm-embed-jina 0.1 — Embedding models from Jina AI

26th Oct 2023, 1:09 am · llm

Release llm-gpt4all 0.2 — Plugin for LLM adding support for the GPT4All collection of models

24th Oct 2023, 7:34 pm · llm