Simon Willison’s Weblog

Subscribe
Atom feed for sqlite-utils Random

237 posts tagged “sqlite-utils”

sqlite-utils is a Python library and command-line utility for creating and manipulating SQLite databases.

2024

fastlite (via) New Python library from Jeremy Howard that adds some neat utility functions and syntactic sugar to my sqlite-utils Python library, specifically for interactive use in Jupyter notebooks.

The autocomplete support through newly exposed dynamic properties is particularly neat, as is the diagram(db.tables) utility for rendering a graphviz diagram showing foreign key relationships between all of the tables.

# 27th May 2024, 9:14 pm / python, sqlite, jupyter, sqlite-utils, jeremy-howard

2023

Release sqlite-utils-shell 0.3 — Interactive shell for sqlite-utils

Weeknotes: datasette-enrichments, datasette-comments, sqlite-chronicle

Visit Weeknotes: datasette-enrichments, datasette-comments, sqlite-chronicle

I’ve mainly been working on Datasette Enrichments and continuing to explore the possibilities enabled by sqlite-chronicle.

[... 1,123 words]

Release sqlite-utils 3.36 — Python CLI utility and library for manipulating SQLite databases

Weeknotes: DevDay, GitHub Universe, OpenAI chaos

Three weeks of conferences and Datasette Cloud work, four days of chaos for OpenAI.

[... 766 words]

Release sqlite-utils 3.35.2 — Python CLI utility and library for manipulating SQLite databases

DALL-E 3, GPT4All, PMTiles, sqlite-migrate, datasette-edit-schema

Visit DALL-E 3, GPT4All, PMTiles, sqlite-migrate, datasette-edit-schema

I wrote a lot this week. I also did some fun research into new options for self-hosting vector maps and pushed out several new releases of plugins.

[... 1,362 words]

Release sqlite-migrate 0.1b0 — A simple database migration system for SQLite, based on sqlite-utils

Weeknotes: Embeddings, more embeddings and Datasette Cloud

Since my last weeknotes, a flurry of activity. LLM has embeddings support now, and Datasette Cloud has driven some major improvements to the wider Datasette ecosystem.

[... 2,427 words]

Release sqlite-utils 3.35.1 — Python CLI utility and library for manipulating SQLite databases
Release sqlite-migrate 0.1a2 — A simple database migration system for SQLite, based on sqlite-utils
Release sqlite-utils-move-tables 0.1 — sqlite-utils plugin adding a move-tables command

Datasette 1.0a4 and 1.0a5, plus weeknotes

Two new alpha releases of Datasette, plus a keynote at WordCamp, a new LLM release, two new LLM plugins and a flurry of TILs.

[... 2,709 words]

Release sqlite-utils-fast-fks 0.1 — Fast foreign key addition for sqlite-utils
Release sqlite-utils 3.35 — Python CLI utility and library for manipulating SQLite databases

Datasette Cloud, Datasette 1.0a3, llm-mlc and more

Visit Datasette Cloud, Datasette 1.0a3, llm-mlc and more

Datasette Cloud is now a significant step closer to general availability. The Datasette 1.03 alpha release is out, with a mostly finalized JSON format for 1.0. Plus new plugins for LLM and sqlite-utils and a flurry of things I’ve learned.

[... 1,690 words]

Release sqlite-utils-jq 0.1 — Plugin adding a jq() SQL function to sqlite-utils

Weeknotes: Plugins for LLM, sqlite-utils and Datasette

Visit Weeknotes: Plugins for LLM, sqlite-utils and Datasette

The principle theme for the past few weeks has been plugins.

[... 1,203 words]

Release sqlite-utils-litecli 0.1.1 — Interactive shell for sqlite-utils using litecli
Release sqlite-utils-litecli 0.1 — Interactive shell for sqlite-utils using litecli

sqlite-utils now supports plugins

Visit sqlite-utils now supports plugins

sqlite-utils 3.34 is out with a major new feature: support for plugins.

[... 1,327 words]

Release sqlite-utils-shell 0.2 — Interactive shell for sqlite-utils
Release sqlite-utils-shell 0.1 — Interactive shell for sqlite-utils
Release sqlite-utils-dateutil 0.1 — Date utility functions for sqlite-utils
Release sqlite-migrate 0.1a1 — A simple database migration system for SQLite, based on sqlite-utils
Release sqlite-migrate 0.1a0 — A simple database migration system for SQLite, based on sqlite-utils
Release sqlite-utils 3.34 — Python CLI utility and library for manipulating SQLite databases

Weeknotes: Self-hosted language models with LLM plugins, a new Datasette tutorial, a dozen package releases, a dozen TILs

A lot of stuff to cover from the past two and a half weeks.

[... 1,742 words]

Release sqlite-utils 3.33 — Python CLI utility and library for manipulating SQLite databases

Migrating out of PostHaven. Amjith Ramanujam decided to migrate his blog content from PostHaven to a Markdown static site. He used shot-scraper (shelled out to from a Python script) to scrape his existing content using a snippet of JavaScript, wrote the content to a SQLite database using sqlite-utils, then used markdownify (new to me, a neat Python package for converting HTML to Markdown via BeautifulSoup) to write the content to disk as Markdown.

# 24th May 2023, 7:38 pm / beautifulsoup, markdown, sqlite-utils, shot-scraper