Simon Willison on llm

610 posts tagged “llm”

LLM is my command-line tool for running prompts against Large Language Models.

2024

llm-embed-onnx. I wrote a new plugin for LLM that acts as a thin wrapper around onnx_embedding_models by Benjamin Anderson, providing access to seven embedding models that can run on the ONNX model framework.

The actual plugin is around 50 lines of code, which makes for a nice example of how thin a plugin wrapper can be that adds new models to my LLM tool.

# 28th January 2024, 10:28 pm / embedding, plugins, projects, ai, llm, onnx

Release llm-embed-onnx 0.1 — Run embedding models using ONNX

28th Jan 2024, 10:21 pm · llm, onnx

Release llm 0.13.1 — Access large language models from the command-line

27th Jan 2024, 12:28 am · llm

LLM 0.13: The annotated release notes

I just released LLM 0.13, the latest version of my LLM command-line tool for working with Large Language Models—both via APIs and running models locally using plugins.

[... 1,278 words]

11:08 pm / 26th January 2024 / projects, ai, annotated-release-notes, openai, generative-ai, llms, llm

Release llm 0.13 — Access large language models from the command-line

26th Jan 2024, 10:34 pm · llm

Release llm-gpt4all 0.3 — Plugin for LLM adding support for the GPT4All collection of models

24th Jan 2024, 3:17 am · llm

Talking about Open Source LLMs on Oxide and Friends

I recorded an episode of the Oxide and Friends podcast on Monday, talking with Bryan Cantrill and Adam Leventhal about Open Source LLMs.

[... 1,995 words]

9:39 pm / 17th January 2024 / open-source, podcasts, ai, generative-ai, whisper, llms, llm, anthropic, claude, oxide, bryan-cantrill, podcast-appearances

2023

Many options for running Mistral models in your terminal using LLM

Mistral AI is the most exciting AI research lab at the moment. They’ve now released two extremely powerful smaller Large Language Models under an Apache 2 license, and have a third much larger one that’s available via their API.

[... 2,063 words]

6:18 pm / 18th December 2023 / cli, plugins, projects, ai, generative-ai, local-llms, llms, llm, mistral, llamafile, llama-cpp, openrouter

Release llm-mistral 0.2 — LLM plugin providing access to Mistral models using the Mistral API

15th Dec 2023, 5:05 am · llm, mistral

Release llm-mistral 0.1 — LLM plugin providing access to Mistral models using the Mistral API

15th Dec 2023, 4:04 am · llm, mistral

Release llm-anyscale-endpoints 0.4 — LLM plugin for models hosted by Anyscale Endpoints

14th Dec 2023, 4:55 am · llm

Release llm-gemini 0.1a0 — LLM plugin to access Google's Gemini family of models

13th Dec 2023, 8:22 pm · llm, gemini

Release llm-llama-cpp 0.3 — LLM plugin for running models using llama.cpp

9th Dec 2023, 5:48 am · llm

ospeak: a CLI tool for speaking text in the terminal via OpenAI

I attended OpenAI DevDay today, the first OpenAI developer conference. It was a lot. They released a bewildering array of new API tools, which I’m just beginning to wade my way through fully understanding.

[... 1,109 words]

4:54 am / 7th November 2023 / cli, projects, ai, openai, generative-ai, chatgpt, gpt-4, llms, llm, gpt

Release llm 0.12 — Access large language models from the command-line

6th Nov 2023, 9:33 pm · llm

Release llm 0.11.2 — Access large language models from the command-line

6th Nov 2023, 8:08 pm · llm

Release llm-anyscale-endpoints 0.3 — LLM plugin for models hosted by Anyscale Endpoints

3rd Nov 2023, 5:24 am · llm

Release llm 0.11.1 — Access large language models from the command-line

1st Nov 2023, 4:31 am · llm

DALL-E 3, GPT4All, PMTiles, sqlite-migrate, datasette-edit-schema

I wrote a lot this week. I also did some fun research into new options for self-hosting vector maps and pushed out several new releases of plugins.

[... 1,362 words]

11:59 pm / 30th October 2023 / mapping, projects, weeknotes, sqlite-utils, llm, overture

Release llm-python 0.1 — "llm python" is a command to run a Python interpreter in the LLM virtual environment

27th Oct 2023, 5:37 am · llm

Execute Jina embeddings with a CLI using llm-embed-jina

Berlin-based Jina AI just released a new family of embedding models, boasting that they are the “world’s first open-source 8K text embedding model” and that they rival OpenAI’s text-embedding-ada-002 in quality.

[... 1,392 words]

3:47 am / 26th October 2023 / cli, plugins, projects, ai, embeddings, llm, jina

Release llm-embed-jina 0.1.2 — Embedding models from Jina AI

26th Oct 2023, 3:03 am · llm

Release llm-embed-jina 0.1.1 — Embedding models from Jina AI

26th Oct 2023, 1:26 am · llm

Release llm-embed-jina 0.1 — Embedding models from Jina AI

26th Oct 2023, 1:09 am · llm

Release llm-gpt4all 0.2 — Plugin for LLM adding support for the GPT4All collection of models

24th Oct 2023, 7:34 pm · llm

Embeddings: What they are and why they matter

Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon.

[... 5,835 words]

1:36 pm / 23rd October 2023 / my-talks, ai, generative-ai, vector-search, embeddings, llm, annotated-talks, rag, clip

Open questions for AI engineering

Last week I gave the closing keynote at the AI Engineer Summit in San Francisco. I was asked by the organizers to both summarize the conference, summarize the last year of activity in the space and give the audience something to think about by posing some open questions for them to take home.

[... 6,928 words]

2:18 pm / 17th October 2023 / my-talks, ai, generative-ai, llms, llm, annotated-talks, code-interpreter, coding-agents

Release datasette-llm-embed 0.2 — Datasette plugin adding a llm_embed(model_id, text) SQL function

8th Oct 2023, 5:42 pm · datasette, llm

Release datasette-llm-embed 0.1 — Datasette plugin adding a llm_embed(model_id, text) SQL function

8th Oct 2023, 4:31 am · datasette, llm

Release datasette-llm-embed 0.1a1 — Datasette plugin adding a llm_embed(model_id, text) SQL function

8th Oct 2023, 1:36 am · datasette, llm

«« first « previous page 18 / 21 next » last »»