Simon Willison’s Weblog

Subscribe
Atom feed for llm Random

600 posts tagged “llm”

LLM is my command-line tool for running prompts against Large Language Models.

2023

Release llm-mlc 0.3 — LLM plugin for running models using MLC
Release llm-mlc 0.2 — LLM plugin for running models using MLC
Release llm-mlc 0.1a0 — LLM plugin for running models using MLC

Weeknotes: Plugins for LLM, sqlite-utils and Datasette

Visit Weeknotes: Plugins for LLM, sqlite-utils and Datasette

The principle theme for the past few weeks has been plugins.

[... 1,203 words]

Catching up on the weird world of LLMs

Visit Catching up on the weird world of LLMs

I gave a talk on Sunday at North Bay Python where I attempted to summarize the last few years of development in the space of LLMs—Large Language Models, the technology behind tools like ChatGPT, Google Bard and Llama 2.

[... 10,489 words]

Run Llama 2 on your own Mac using LLM and Homebrew

Llama 2 is the latest commercially usable openly licensed Large Language Model, released by Meta AI a few weeks ago. I just released a new plugin for my LLM utility that adds support for Llama 2 and many other llama-cpp compatible models.

[... 1,423 words]

Release llm-llama-cpp 0.1a0 — LLM plugin for running models using llama.cpp
Release llm-gpt4all 0.1.1 — Plugin for LLM adding support for the GPT4All collection of models

LLM can now be installed directly from Homebrew (via) I spent a bunch of time on this at the weekend: my LLM tool for interacting with large language models from the terminal has now been accepted into Homebrew core, and can be installed directly using “brew install llm”. I was previously running my own separate tap, but having it in core means that it benefits from Homebrew’s impressive set of build systems—each release of LLM now has Bottles created for it automatically across a range of platforms, so “brew install llm” should quickly download binary assets rather than spending several minutes installing dependencies the slow way.

# 24th July 2023, 5:16 pm / llm, generative-ai, projects, homebrew, ai, llms

Release llm 0.6.1 — Access large language models from the command-line
Release llm-replicate 0.3 — LLM plugin for models hosted on Replicate
Release llm 0.6 — Access large language models from the command-line

Accessing Llama 2 from the command-line with the llm-replicate plugin

Visit Accessing Llama 2 from the command-line with the llm-replicate plugin

The big news today is Llama 2, the new openly licensed Large Language Model from Meta AI. It’s a really big deal:

[... 1,206 words]

Release llm-replicate 0.2 — LLM plugin for models hosted on Replicate
Release llm-replicate 0.1 — LLM plugin for models hosted on Replicate

Weeknotes: Self-hosted language models with LLM plugins, a new Datasette tutorial, a dozen package releases, a dozen TILs

A lot of stuff to cover from the past two and a half weeks.

[... 1,742 words]

Release llm-mpt30b 0.1 — LLM plugin adding support for the MPT-30B language model
Release llm-markov 0.1 — Plugin for LLM adding a Markov chain generating model
Release llm-gpt4all 0.1 — Plugin for LLM adding support for the GPT4All collection of models
Release llm-palm 0.1 — Plugin for LLM adding support for Google's PaLM 2 model

My LLM CLI tool now supports self-hosted language models via plugins

Visit My LLM CLI tool now supports self-hosted language models via plugins

LLM is my command-line utility and Python library for working with large language models such as GPT-4. I just released version 0.5 with a huge new feature: you can now install plugins that add support for additional models to the tool, including models that can run on your own hardware.

[... 1,656 words]

Release llm 0.5 — Access large language models from the command-line

Weeknotes: symbex, LLM prompt templates, a bit of a break

I had a holiday to the UK for a family wedding anniversary and mostly took the time off... except for building symbex, which became one of those projects that kept on inspiring new features.

[... 1,120 words]

Release llm 0.4.1 — Access large language models from the command-line
Release llm 0.4 — Access large language models from the command-line

llm, ttok and strip-tags—CLI tools for working with ChatGPT and other LLMs

Visit llm, ttok and strip-tags - CLI tools for working with ChatGPT and other LLMs

I’ve been building out a small suite of command-line tools for working with ChatGPT, GPT-4 and potentially other language models in the future.

[... 1,328 words]

Release llm 0.3 — Access large language models from the command-line

Weeknotes: A new llm CLI tool, plus automating my weeknotes and newsletter

Visit Weeknotes: A new llm CLI tool, plus automating my weeknotes and newsletter

I started publishing weeknotes in 2019 partly as a way to hold myself accountable but mainly as a way to encourage myself to write more.

[... 830 words]

Release llm 0.2 — Access large language models from the command-line
Release llm 0.1 — Access large language models from the command-line