Simon Willison’s Weblog

Subscribe
Atom feed for datasette Random

1,521 posts tagged “datasette”

Datasette is an open source tool for exploring and publishing data.

2021

Stanford School Enrollment Project (via) This is Project Pelican: I’ve been working with the Big Local News team at Stanford helping bundle up and release the data they’ve been collecting on school enrollment statistics around the USA. This Datasette instance has data from 33 states for every year since 2015—3.3m rows total. Be sure to check out the accompanying documentation!

# 8th August 2021, 12:23 am / data-journalism, journalism, datasette

Release datasette 0.59a0 — An open source multi-tool for exploring and publishing data

Apply conversion functions to data in SQLite columns with the sqlite-utils CLI tool

Visit Apply conversion functions to data in SQLite columns with the sqlite-utils CLI tool

Earlier this week I released sqlite-utils 3.14 with a powerful new command-line tool: sqlite-utils convert, which applies a conversion function to data stored in a SQLite column.

[... 1,941 words]

Release datasette-json-html 1.0.1 — Datasette plugin for rendering HTML based on JSON values
Release datasette-json-html 1.0 — Datasette plugin for rendering HTML based on JSON values
Release datasette-publish-fly 1.0.2 — Datasette plugin for publishing data using Fly

Weeknotes: datasette-remote-metadata, sqlite-transform --multi

I mentioned Project Pelican (still a codename until the end of the embargo) last week. This week it inspired a new plugin, datasette-remote-metadata.

[... 595 words]

Release datasette-remote-metadata 0.1 — Periodically refresh Datasette metadata from a remote URL
Release datasette-remote-metadata 0.1a0 — Periodically refresh Datasette metadata from a remote URL

The Baked Data architectural pattern

Visit The Baked Data architectural pattern

I’ve been exploring an architectural pattern for publishing websites over the past few years that I call the “Baked Data” pattern. It provides many of the advantages of static site generators while avoiding most of their limitations. I think it deserves to be used more widely.

[... 1,896 words]

Release datasette-haversine 0.2 — Datasette plugin that adds a custom SQL function for haversine distances
Release datasette-publish-vercel 0.10 — Datasette plugin for publishing data using Vercel

Datasette—an ecosystem of tools for working with small data

Visit Datasette - an ecosystem of tools for working with small data

This is the transcript and video from a talk I gave at PyGotham 2020 about using SQLite, Datasette and Dogsheep to work with small data.

[... 4,655 words]

Weeknotes: sqlite-transform 1.1, Datasette 0.58.1, datasette-graphql 1.5

Work on Project Pelican inspires new features and improvements across a number of different projects.

[... 1,419 words]

Datasette downloads per day (with Observable Plot) (via) I built an Observable notebook that imports PyPI package download data from datasette.io (itself scraped from pypistats.org using a scheduled GitHub Action) and plots it using Observable Plot. Datasette downloads from PyPI apparently jumped from ~800/day in May to ~4,000/day in July—would love to know why!

# 17th July 2021, 5:01 pm / pypi, datasette, observable, observable-plot

Release datasette-export-notebook 1.0 — Datasette plugin providing instructions for exporting data to Jupyter or Observable
Release datasette-graphql 1.5 — Datasette plugin providing an automatic GraphQL API for your SQLite databases
Release datasette 0.58.1 — An open source multi-tool for exploring and publishing data

Datasette 0.58: The annotated release notes

I released Datasette 0.58 last night, with new plugin hooks, Unix domain socket support, a major faceting performance fix and a few other improvements. Here are the annotated release notes.

[... 1,062 words]

Release datasette 0.58 — An open source multi-tool for exploring and publishing data

Weeknotes: Fun with Unix domain sockets

A small enhancement to Datasette this week: I’ve added support for proxying via Unix domain sockets.

[... 809 words]

Django SQL Dashboard 1.0

Visit Django SQL Dashboard 1.0

Earlier this week I released Django SQL Dashboard 1.0. I also just released 1.0.1, with a bug fix for PostgreSQL 10 contributed by Ryan Cheley.

[... 629 words]

Weeknotes: sqlite-utils updates, Datasette and asgi-csrf, open-sourcing VIAL

Some work on sqlite-utils, asgi-csrf, a Datasette alpha and we open-sourced VIAL.

[... 662 words]

A Datasette tutorial in Portuguese. Nicolás Linares put together this Datasette tutorial in Portuguese, including an explanation of the project, how to get it up and running on a laptop, how to use it to explore and facet data, how to use plugins (including datasette-vega and datasette-cluster-map) and how to publish data using Vercel. I ran this through Google Translate and I can confirm that it’s a really well constructed tutorial—fantastic to see material like this starting to emerge in languages other than English.

# 25th June 2021, 10:57 pm / datasette

Release datasette 0.58a1 — An open source multi-tool for exploring and publishing data

Weeknotes: New releases across nine different projects

A new release and security patch for Datasette, plus releases of sqlite-utils, datasette-auth-passwords, django-sql-dashboard, datasette-upload-csvs, xml-analyser, datasette-placekey, datasette-mask-columns and db-to-sqlite.

[... 861 words]

Release datasette-mask-columns 0.2.1 — Datasette plugin that masks specified database columns
Release datasette 0.58a0 — An open source multi-tool for exploring and publishing data
Release datasette 0.57.1 — An open source multi-tool for exploring and publishing data
Release datasette-upload-csvs 0.6.1 — Datasette plugin for uploading CSV files and converting them to database tables