Simon Willison’s Weblog

Subscribe
Atom feed for llm Random

599 posts tagged “llm”

LLM is my command-line tool for running prompts against Large Language Models.

2023

Release llm 0.10 — Access large language models from the command-line
12th Sep 2023, 7:13 pm · llm
Release llm-clip 0.1a0 — Generate embeddings for images and text using CLIP with LLM
12th Sep 2023, 6:32 am · llm
Release llm 0.10a1 — Access large language models from the command-line
12th Sep 2023, 6 am · llm
Release datasette-llm-embed 0.1a0 — Datasette plugin adding a llm_embed(model_id, text) SQL function
8th Sep 2023, 9:50 pm · llm, datasette
Release llm-sentence-transformers 0.1.1 — LLM plugin for embeddings using sentence-transformers
8th Sep 2023, 8:45 pm · llm

hubcap.php (via) This PHP script by Dave Hulbert delights me. It’s 24 lines of code that takes a specified goal, then calls my LLM utility on a loop to request the next shell command to execute in order to reach that goal... and pipes the output straight into `exec()` after a 3s wait so the user can panic and hit Ctrl+C if it’s about to do something dangerous!

# 6th September 2023, 3:45 pm / llm, security, php, generative-ai, ai, llms, ai-agents

Symbex 1.4. New release of my Symbex tool for finding symbols (functions, methods and classes) in a Python codebase. Symbex can now output matching symbols in JSON, CSV or TSV in addition to plain text.

I designed this feature for compatibility with the new “llm embed-multi” command—so you can now use Symbex to find every Python function in a nested directory and then pipe them to LLM to calculate embeddings for every one of them.

I tried it on my projects directory and embedded over 13,000 functions in just a few minutes! Next step is to figure out what kind of interesting things I can do with all of those embeddings.

# 5th September 2023, 5:29 pm / symbex, llm, generative-ai, projects, ai, embeddings

Release llm 0.10a0 — Access large language models from the command-line
5th Sep 2023, 6:43 am · llm

LLM now provides tools for working with embeddings

Visit LLM now provides tools for working with embeddings

LLM is my Python library and command-line tool for working with language models. I just released LLM 0.9 with a new set of features that extend LLM to provide tools for working with embeddings.

[... 3,521 words]

8:32 pm / 4th September 2023 / llm, sqlite, ai, llms, open-source, generative-ai, projects, embeddings, rag, cli, vector-search
Release llm-cluster 0.2 — LLM plugin for clustering embeddings
4th Sep 2023, 4:34 pm · llm
Release llm-cluster 0.1 — LLM plugin for clustering embeddings
4th Sep 2023, 4:01 pm · llm
Release llm-sentence-transformers 0.1 — LLM plugin for embeddings using sentence-transformers
4th Sep 2023, 2:47 am · llm
Release llm 0.9 — Access large language models from the command-line
4th Sep 2023, 2:40 am · llm
Release llm 0.9a1 — Access large language models from the command-line
4th Sep 2023, 1:28 am · llm
Release llm 0.9a0 — Access large language models from the command-line
2nd Sep 2023, 5:54 pm · llm
Release llm 0.8.1 — Access large language models from the command-line
1st Sep 2023, 3:35 am · llm

Datasette 1.0a4 and 1.0a5, plus weeknotes

Two new alpha releases of Datasette, plus a keynote at WordCamp, a new LLM release, two new LLM plugins and a flurry of TILs.

[... 2,709 words]

2:33 pm / 30th August 2023 / llm, projects, datasette, plugins, sqlite-utils, alex-garcia, weeknotes, annotated-release-notes

Making Large Language Models work for you

Visit Making Large Language Models work for you

I gave an invited keynote at WordCamp 2023 in National Harbor, Maryland on Friday.

[... 14,189 words]

2:35 pm / 27th August 2023 / llm, generative-ai, annotated-talks, wordpress, ai, speaking, llms, rag, code-interpreter, my-talks, coding-agents
Release llm-anyscale-endpoints 0.2 — LLM plugin for models hosted by Anyscale Endpoints
25th Aug 2023, 11:24 am · llm
Release llm-anyscale-endpoints 0.1 — LLM plugin for models hosted by Anyscale Endpoints
23rd Aug 2023, 8:40 pm · llm
Release llm-openrouter 0.1 — LLM plugin for models hosted by OpenRouter
21st Aug 2023, 7:03 am · llm
Release llm 0.8 — Access large language models from the command-line
21st Aug 2023, 6:55 am · llm
Release llm 0.7.1 — Access large language models from the command-line
19th Aug 2023, 9:08 pm · llm

Datasette Cloud, Datasette 1.0a3, llm-mlc and more

Visit Datasette Cloud, Datasette 1.0a3, llm-mlc and more

Datasette Cloud is now a significant step closer to general availability. The Datasette 1.03 alpha release is out, with a mostly finalized JSON format for 1.0. Plus new plugins for LLM and sqlite-utils and a flurry of things I’ve learned.

[... 1,690 words]

11:19 pm / 16th August 2023 / weeknotes, sqlite-utils, llm, datasette-cloud, plugins, datasette, projects

Running my own LLM (via) Nelson Minar describes running LLMs on his own computer using my LLM tool and llm-gpt4all plugin, plus some notes on trying out some of the other plugins.

# 16th August 2023, 10:42 pm / llm, nelson-minar, local-llms, llms

Release llm-mlc 0.5 — LLM plugin for running models using MLC
15th Aug 2023, 4:22 am · llm
Release llm-mlc 0.4 — LLM plugin for running models using MLC
14th Aug 2023, 12:21 am · llm
Release llm 0.7 — Access large language models from the command-line
12th Aug 2023, 4:41 pm · llm

llm-mlc (via) My latest plugin for LLM adds support for models that use the MLC Python library—which is the first library I’ve managed to get to run Llama 2 with GPU acceleration on my M2 Mac laptop.

# 12th August 2023, 5:33 am / llm, projects, generative-ai, mlc, ai, llms, plugins

Release llm-mlc 0.3 — LLM plugin for running models using MLC
12th Aug 2023, 5:26 am · llm

Related