Simon Willison on llm

97 items tagged “llm”

LLM is my command-line tool for running prompts against Large Language Models.

2023

LLM can now be installed directly from Homebrew (via) I spent a bunch of time on this at the weekend: my LLM tool for interacting with large language models from the terminal has now been accepted into Homebrew core, and can be installed directly using “brew install llm”. I was previously running my own separate tap, but having it in core means that it benefits from Homebrew’s impressive set of build systems—each release of LLM now has Bottles created for it automatically across a range of platforms, so “brew install llm” should quickly download binary assets rather than spending several minutes installing dependencies the slow way.

# 24th July 2023, 5:16 pm / llm, generative-ai, projects, homebrew, ai, llms

Accessing Llama 2 from the command-line with the llm-replicate plugin

The big news today is Llama 2, the new openly licensed Large Language Model from Meta AI. It’s a really big deal:

[... 1,206 words]

7:30 pm / 18th July 2023 / llm, plugins, llama, ai, llms, generative-ai, replicate, projects, edge-llms

Weeknotes: Self-hosted language models with LLM plugins, a new Datasette tutorial, a dozen package releases, a dozen TILs

A lot of stuff to cover from the past two and a half weeks.

[... 1,742 words]

5:55 am / 16th July 2023 / symbex, sqlite-utils, llm, plugins, tutorials, ai, edge-llms, llms, datasette, generative-ai, projects, weeknotes

My LLM CLI tool now supports self-hosted language models via plugins

LLM is my command-line utility and Python library for working with large language models such as GPT-4. I just released version 0.5 with a huge new feature: you can now install plugins that add support for additional models to the tool, including models that can run on your own hardware.

[... 1,656 words]

2:24 pm / 12th July 2023 / generative-ai, projects, ai, edge-llms, llms, llm

Weeknotes: symbex, LLM prompt templates, a bit of a break

I had a holiday to the UK for a family wedding anniversary and mostly took the time off... except for building symbex, which became one of those projects that kept on inspiring new features.

[... 1,120 words]

4:30 pm / 27th June 2023 / generative-ai, projects, ai, weeknotes, llms, symbex, llm