Simon Willison’s Weblog

Subscribe

Posts tagged llama, llms in Jul, 2023

Filters: Year: 2023 × Month: Jul × llama × llms × Sorted by date

llama2-mac-gpu.sh (via) Adrien Brault provided this recipe for compiling llama.cpp on macOS with GPU support enabled (“LLAMA_METAL=1 make”) and then downloading and running a GGML build of Llama 2 13B.

# 19th July 2023, 4:04 am / macos, ai, generative-ai, llama, local-llms, llms, llama-cpp

Ollama (via) This tool for running LLMs on your own laptop directly includes an installer for macOS (Apple Silicon) and provides a terminal chat interface for interacting with models. They already have Llama 2 support working, with a model that downloads directly from their own registry service without need to register for an account or work your way through a waiting list.

# 18th July 2023, 9 pm / ai, generative-ai, llama, local-llms, llms, ollama

Accessing Llama 2 from the command-line with the llm-replicate plugin

Visit Accessing Llama 2 from the command-line with the llm-replicate plugin

The big news today is Llama 2, the new openly licensed Large Language Model from Meta AI. It’s a really big deal:

[... 1,206 words]

7:30 pm / 18th July 2023 / cli, plugins, projects, ai, generative-ai, llama, local-llms, llms, replicate, llm, llm-release

Types

Years

Months

Tags