Simon Willison’s Weblog

Subscribe

August 2020

110 posts: 5 entries, 10 links, 5 quotes, 90 beats

Aug. 16, 2020

TIL Read the Docs Search API — I stumbled across this API today: https://docs.datasette.io/_/api/v2/docsearch/?q=startup&project=datasette&version=stable&language=en

Aug. 17, 2020

Release datasette-publish-vercel 0.8 — Datasette plugin for publishing data using Vercel

Aug. 18, 2020

Release github-to-sqlite 2.5 — Save data from GitHub to a SQLite database
TIL Programatically accessing Heroku PostgreSQL from GitHub Actions — My [db-to-sqlite](https://github.com/simonw/db-to-sqlite) tool can connect to a PostgreSQL database, export all of the content and write it to a SQLite database file on disk.

Aug. 19, 2020

Release datasette-graphql 0.12.3 — Datasette plugin providing an automatic GraphQL API for your SQLite databases
Release datasette-schema-versions 0.1 — Datasette plugin that shows the schema version of every attached database
Release datasette-graphql 0.13 — Datasette plugin providing an automatic GraphQL API for your SQLite databases

Announcing the Consortium for Python Data API Standards (via) Interesting effort to unify the fragmented DataFrame API ecosystem, where increasing numbers of libraries offer APIs inspired by Pandas that imitate each other but aren’t 100% compatible. The announcement includes some very clever code to support the effort: custom tooling to compare the existing APIs, and an ingenious GitHub Actions setup to run traces (via sys.settrace), derive type signatures and commit those generated signatures back to a repository.

# 5:48 am / python, standards, data-science, github-actions

TIL Finding the largest SQLite files on a Mac — This runs using Spotlight so it's really fast:

Aug. 20, 2020

TIL Using grep to write tests in CI — GitHub Actions workflows fail if any of the steps executes something that returns a non-zero exit code.
Release datasette-graphql 0.14 — Datasette plugin providing an automatic GraphQL API for your SQLite databases

Aug. 21, 2020

Weeknotes: Rocky Beaches, Datasette 0.48, a commit history of my database

Visit Weeknotes: Rocky Beaches, Datasette 0.48, a commit history of my database

This week I helped Natalie launch Rocky Beaches, shipped Datasette 0.48 and several releases of datasette-graphql, upgraded the CSRF protection for datasette-upload-csvs and figured out how to get a commit log of changes to my blog by backing up its database to a GitHub repository.

[... 1,294 words]

Why weekly? You want to keep your finger on the pulse of what’s really going on. When 1:1s are scheduled bi-weekly, and either of you have to cancel, you’ll likely be going a month between conversations and that is far too long to go without having a 1:1 with your direct report. Think of how much happens in a month. You don’t want to be that far behind!

Adrienne Lowe

# 5:02 pm / management

Release sqlite-utils 2.16 — Python CLI utility and library for manipulating SQLite databases
Release datasette-leaflet-geojson 0.5 — Datasette plugin that replaces any GeoJSON column values with a Leaflet map.
TIL Working around the size limit for nodeValue in the DOM — TIL that `nodeValue` in the DOM has a size limit!

California Protected Areas Database in Datasette (via) I built this yesterday: it’s a Datasette interface on top of the CPAD 2020 GIS database of protected areas in California maintained by GreenInfo Network. This was a useful excuse to build a GitHub Actions flow that builds a SpatiaLite database using my shapefile-to-sqlite tool, and I fixed a few bugs in my datasette-leaflet-geojson plugin as well.

# 11:15 pm / gis, projects, shapefiles, spatialite, california, datasette, github-actions

Release datasette-leaflet-geojson 0.6 — Datasette plugin that replaces any GeoJSON column values with a Leaflet map.

Aug. 22, 2020

Release shapefile-to-sqlite 0.3 — Load shapefiles into a SQLite (optionally SpatiaLite) database
Release datasette-auth-passwords 0.3.2 — Datasette plugin for authentication using passwords
TIL Outputting JSON with reduced floating point precision — [datasette-leaflet-geojson](github.com/simonw/datasette-leaflet-geojson) outputs GeoJSON geometries in HTML pages in a way that can be picked up by JavaScript and used to plot a Leaflet map.
TIL Dynamically loading multiple assets with a callback — For [datasette-leaflet-geojson](https://github.com/simonw/datasette-leaflet-geojson) I wanted to dynamically load some external CSS and JavaScript and then execute some code once they had loaded ([issue 14](https://github.com/simonw/datasette-leaflet-geojson/issues/14)).
TIL Providing a "subscribe in Google Calendar" link for an ics feed — If you provide your own custom generated ICS file hosted at a URL it's nice to be able to give Google Calendar users an easy way to subscribe to that feed.
TIL Creating a dynamic line chart with SVG — I helped build the tide chart visualizations for [Rocky Beaches](https://www.rockybeaches.com/).

Aug. 23, 2020

TIL Skipping a GitHub Actions step without failing — I wanted to have a GitHub Action step run that might fail, but if it failed the rest of the steps should still execute and the overall run should be treated as a success.
Release shapefile-to-sqlite 0.4 — Load shapefiles into a SQLite (optionally SpatiaLite) database
TIL Rendering Markdown with the GitHub Markdown API — I wanted to convert the Markdown used in my TILs to HTML, using the exact same configuration as GitHub does. GitHub has a whole load of custom extensions for things like tables and syntax highlighting (see [issue 17](https://github.com/simonw/til/issues/17)).
Release shapefile-to-sqlite 0.4.1 — Load shapefiles into a SQLite (optionally SpatiaLite) database
Release datasette-atom 0.7 — Datasette plugin that adds a .atom output format
Release datasette-render-images 0.3.2 — Datasette plugin that renders binary blob images using data-uris

2020 » August

MTWTFSS
     12
3456789
10111213141516
17181920212223
24252627282930
31