Simon Willison’s Weblog

Subscribe
Atom feed for datasette Random

1,521 posts tagged “datasette”

Datasette is an open source tool for exploring and publishing data.

2022

Release datasette-socrata 0.1 — Import data from Socrata into Datasette
Release datasette-upload-csvs 0.7.1 — Datasette plugin for uploading CSV files and converting them to database tables

Weeknotes: Datasette Cloud ready to preview

I made an absolute ton of progress building Datasette Cloud on Fly this week, and also had a bunch of fun playing with GPT-3.

[... 370 words]

Release datasette-upload-csvs 0.7 — Datasette plugin for uploading CSV files and converting them to database tables

A Datasette tutorial written by GPT-3

I’ve been playing around with OpenAI’s GPT-3 language model playground for a few months now. It’s a fascinating piece of software. You can sign up here—apparently there’s no longer a waiting list.

[... 1,244 words]

Release datasette-graphql 2.0.2 — Datasette plugin providing an automatic GraphQL API for your SQLite databases
Release datasette-auth-existing-cookies 1.0a1 — Datasette plugin that authenticates users based on existing domain cookies
Release datasette-auth-existing-cookies 1.0a0 — Datasette plugin that authenticates users based on existing domain cookies

Architecture Notes: Datasette (via) I was interviewed for the first edition of Architecture Notes—a new publication (website and newsletter) about software architecture created by Mahdi Yusuf. We covered a bunch of topics in detail: ASGI, SQLIte and asyncio, Baked Data, plugin hook design, Python in WebAssembly, Python in an Electron app and more. Mahdi also turned my scrappy diagrams into beautiful illustrations for the piece.

# 27th May 2022, 3:20 pm / software-architecture, datasette

Weeknotes: Building Datasette Cloud on Fly Machines, Furo for documentation

Visit Weeknotes: Building Datasette Cloud on Fly Machines, Furo for documentation

Hosting provider Fly released Fly Machines this week. I got an early preview and I’ve been working with it for a few days—it’s a fascinating new piece of technology. I’m using it to get my hosting service for Datasette ready for wider release.

[... 1,005 words]

Release datasette-unsafe-expose-env 0.1 — Datasette plugin to expose some environment variables at /-/env for debugging

simonw/datasette-screenshots (via) I started a new GitHub repository to automate taking screenshots of Datasette for marketing purposes, using my shot-scraper browser automation tool.

# 17th May 2022, 5:56 pm / projects, datasette, github-actions, shot-scraper

Release datasette-upload-dbs 0.1.1 — Upload SQLite database files to Datasette
Release datasette-upload-dbs 0.1 — Upload SQLite database files to Datasette
Release datasette-insert 0.7 — Datasette plugin for inserting and updating data

Weeknotes: Datasette Lite, nogil Python, HYTRADBOI

My big project this week was Datasette Lite, a new way to run Datasette directly in a browser, powered by WebAssembly and Pyodide. I also continued my research into running SQL queries in parallel, described last week. Plus I spoke at HYTRADBOI.

[... 1,434 words]

Datasette Lite: a server-side Python web application running in a browser

Visit Datasette Lite: a server-side Python web application running in a browser

Datasette Lite is a new way to run Datasette: entirely in a browser, taking advantage of the incredible Pyodide project which provides Python compiled to WebAssembly plus a whole suite of useful extras.

[... 4,800 words]

Release datasette 0.62a0 — An open source multi-tool for exploring and publishing data
Release datasette-copy-to-memory 0.2 — Copy database files into an in-memory database on startup
Release datasette-copy-to-memory 0.1a3 — Copy database files into an in-memory database on startup
Release datasette-copy-to-memory 0.1a2 — Copy database files into an in-memory database on startup
Release datasette-copy-to-memory 0.1a1 — Copy database files into an in-memory database on startup
Release datasette-copy-to-memory 0.1a0 — Copy database files into an in-memory database on startup

Automatically opening issues when tracked file content changes

Visit Automatically opening issues when tracked file content changes

I figured out a GitHub Actions pattern to keep track of a file published somewhere on the internet and automatically open a new repository issue any time the contents of that file changes.

[... 1,211 words]

Release datasette-gzip 0.2 — Add gzip compression to Datasette

Weeknotes: Parallel SQL queries for Datasette, plus some middleware tricks

Visit Weeknotes: Parallel SQL queries for Datasette, plus some middleware tricks

A promising new performance optimization for Datasette, plus new datasette-gzip and datasette-total-page-time plugins.

[... 1,534 words]

Release datasette-gzip 0.1 — Add gzip compression to Datasette
Release datasette-total-page-time 0.1 — Add a note to the Datasette footer measuring the total page load time

Useful tricks with pip install URL and GitHub

Visit Useful tricks with pip install URL and GitHub

The pip install command can accept a URL to a zip file or tarball. GitHub provides URLs that can create a zip file of any branch, tag or commit in any repository. Combining these is a really useful trick for maintaining Python packages.

[... 929 words]

Building a Covid sewage Twitter bot (and other weeknotes)

Visit Building a Covid sewage Twitter bot (and other weeknotes)

I built a new Twitter bot today: @covidsewage. It tweets a daily screenshot of the latest Covid sewage monitoring data published by Santa Clara county.

[... 1,079 words]