Simon Willison’s Weblog

Subscribe

Wednesday, 12th July 2023

Release llm 0.5 — Access large language models from the command-line

My LLM CLI tool now supports self-hosted language models via plugins

Visit My LLM CLI tool now supports self-hosted language models via plugins

LLM is my command-line utility and Python library for working with large language models such as GPT-4. I just released version 0.5 with a huge new feature: you can now install plugins that add support for additional models to the tool, including models that can run on your own hardware.

[... 1,656 words]

Release llm-palm 0.1 — Plugin for LLM adding support for Google's PaLM 2 model
Release llm-gpt4all 0.1 — Plugin for LLM adding support for the GPT4All collection of models
Release llm-markov 0.1 — Plugin for LLM adding a Markov chain generating model
Release llm-mpt30b 0.1 — LLM plugin adding support for the MPT-30B language model

claude.ai. Anthropic’s new Claude 2 model is available to use online, and it has a 100k token context window and the ability to upload files to it—I tried uploading a text file with 34,000 tokens in it (according to my ttok CLI tool, counting using the GPT-3.5 tokenizer) and it gave me a workable summary.

# 4:39 pm / ai, generative-ai, llms, anthropic, claude, llm-release

What AI can do with a toolbox... Getting started with Code Interpreter. Ethan Mollick has been doing some very creative explorations of ChatGPT Code Interpreter over the past few months, and has tied a lot of them together into this useful introductory tutorial.

# 8:57 pm / ai, openai, generative-ai, chatgpt, llms, ethan-mollick, code-interpreter, coding-agents

Monday, 10th July 2023
Thursday, 13th July 2023

2023 » July

MTWTFSS
     12
3456789
10111213141516
17181920212223
24252627282930
31