Simon Willison on llm

604 posts tagged “llm”

LLM is my command-line tool for running prompts against Large Language Models.

2024

Talking about Open Source LLMs on Oxide and Friends

I recorded an episode of the Oxide and Friends podcast on Monday, talking with Bryan Cantrill and Adam Leventhal about Open Source LLMs.

[... 1,995 words]

9:39 pm / 17th January 2024 / llm, anthropic, claude, ai, podcasts, llms, open-source, generative-ai, whisper, oxide, bryan-cantrill, podcast-appearances

2023

Many options for running Mistral models in your terminal using LLM

Mistral AI is the most exciting AI research lab at the moment. They’ve now released two extremely powerful smaller Large Language Models under an Apache 2 license, and have a third much larger one that’s available via their API.

[... 2,063 words]

6:18 pm / 18th December 2023 / mistral, llm, plugins, projects, generative-ai, ai, llms, llamafile, llama-cpp, openrouter, local-llms, cli

Release llm-mistral 0.2 — LLM plugin providing access to Mistral models using the Mistral API

15th Dec 2023, 5:05 am · mistral, llm

Release llm-mistral 0.1 — LLM plugin providing access to Mistral models using the Mistral API

15th Dec 2023, 4:04 am · llm, mistral

Release llm-anyscale-endpoints 0.4 — LLM plugin for models hosted by Anyscale Endpoints

14th Dec 2023, 4:55 am · llm

Release llm-gemini 0.1a0 — LLM plugin to access Google's Gemini family of models

13th Dec 2023, 8:22 pm · llm, gemini

Release llm-llama-cpp 0.3 — LLM plugin for running models using llama.cpp

9th Dec 2023, 5:48 am · llm

ospeak: a CLI tool for speaking text in the terminal via OpenAI

I attended OpenAI DevDay today, the first OpenAI developer conference. It was a lot. They released a bewildering array of new API tools, which I’m just beginning to wade my way through fully understanding.

[... 1,109 words]

4:54 am / 7th November 2023 / llm, openai, gpt-4, ai, llms, generative-ai, projects, chatgpt, cli, gpt

Release llm 0.12 — Access large language models from the command-line

6th Nov 2023, 9:33 pm · llm

Release llm 0.11.2 — Access large language models from the command-line

6th Nov 2023, 8:08 pm · llm

Release llm-anyscale-endpoints 0.3 — LLM plugin for models hosted by Anyscale Endpoints

3rd Nov 2023, 5:24 am · llm

Release llm 0.11.1 — Access large language models from the command-line

1st Nov 2023, 4:31 am · llm

DALL-E 3, GPT4All, PMTiles, sqlite-migrate, datasette-edit-schema

I wrote a lot this week. I also did some fun research into new options for self-hosting vector maps and pushed out several new releases of plugins.

[... 1,362 words]

11:59 pm / 30th October 2023 / projects, sqlite-utils, llm, weeknotes, mapping, overture

Release llm-python 0.1 — "llm python" is a command to run a Python interpreter in the LLM virtual environment

27th Oct 2023, 5:37 am · llm

Execute Jina embeddings with a CLI using llm-embed-jina

Berlin-based Jina AI just released a new family of embedding models, boasting that they are the “world’s first open-source 8K text embedding model” and that they rival OpenAI’s text-embedding-ada-002 in quality.

[... 1,392 words]

3:47 am / 26th October 2023 / llm, plugins, projects, ai, embeddings, jina, cli

Release llm-embed-jina 0.1.2 — Embedding models from Jina AI

26th Oct 2023, 3:03 am · llm

Release llm-embed-jina 0.1.1 — Embedding models from Jina AI

26th Oct 2023, 1:26 am · llm

Release llm-embed-jina 0.1 — Embedding models from Jina AI

26th Oct 2023, 1:09 am · llm

Release llm-gpt4all 0.2 — Plugin for LLM adding support for the GPT4All collection of models

24th Oct 2023, 7:34 pm · llm

Embeddings: What they are and why they matter

Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon.

[... 5,835 words]

1:36 pm / 23rd October 2023 / llm, ai, embeddings, generative-ai, annotated-talks, rag, clip, my-talks, vector-search

Open questions for AI engineering

Last week I gave the closing keynote at the AI Engineer Summit in San Francisco. I was asked by the organizers to both summarize the conference, summarize the last year of activity in the space and give the audience something to think about by posing some open questions for them to take home.

[... 6,928 words]

2:18 pm / 17th October 2023 / llm, generative-ai, my-talks, ai, llms, annotated-talks, code-interpreter, coding-agents

Release datasette-llm-embed 0.2 — Datasette plugin adding a llm_embed(model_id, text) SQL function

8th Oct 2023, 5:42 pm · llm, datasette

Release datasette-llm-embed 0.1 — Datasette plugin adding a llm_embed(model_id, text) SQL function

8th Oct 2023, 4:31 am · llm, datasette

Release datasette-llm-embed 0.1a1 — Datasette plugin adding a llm_embed(model_id, text) SQL function

8th Oct 2023, 1:36 am · datasette, llm

Weeknotes: the Datasette Cloud API, a podcast appearance and more

Datasette Cloud now has a documented API, plus a podcast appearance, some LLM plugins work and some geospatial excitement.

[... 1,243 words]

12:03 am / 1st October 2023 / llm, sqlite, datasette-cloud, journalism, ai, alex-garcia, llms, datasette, generative-ai, projects, weeknotes

Talking Large Language Models with Rooftop Ruby

I’m on the latest episode of the Rooftop Ruby podcast with Collin Donnell and Joel Drapper, talking all things LLM.

[... 15,489 words]

3:39 pm / 29th September 2023 / llm, llms, generative-ai, interviews, ai, speaking, podcasts, code-interpreter, podcast-appearances, coding-agents

Release llm-llama-cpp 0.2b1 — LLM plugin for running models using llama.cpp

28th Sep 2023, 3:22 am · llm

Finding Bathroom Faucets with Embeddings. Absolutely the coolest thing I’ve seen someone build on top of my LLM tool so far: Drew Breunig is renovating a bathroom and needed a way to filter through literally thousands of options for facet taps. He scraped 20,000 images of fixtures from a plumbing supply site and used LLM to embed every one of them via CLIP... and now he can ask for “faucets that look like this one”, or even run searches for faucets that match “Gawdy” or “Bond Villain” or “Nintendo 64”. Live demo included!

# 27th September 2023, 6:18 pm / llm, embeddings, generative-ai, ai, drew-breunig, clip

Release llm-llama-cpp 0.2b0 — LLM plugin for running models using llama.cpp

22nd Sep 2023, 3:24 am · llm

LLM 0.11. I released LLM 0.11 with support for the new gpt-3.5-turbo-instruct completion model from OpenAI.

The most interesting feature of completion models is the option to request “log probabilities” from them, where each token returned is accompanied by up to 5 alternatives that were considered, along with their scores.

# 19th September 2023, 3:28 pm / llm, projects, generative-ai, openai, ai, llms

«« first « previous page 18 / 21 next » last »»