Simon Willison’s Weblog

Subscribe

February 2021

80 posts: 11 entries, 11 links, 6 quotes, 52 beats

Feb. 1, 2021

JMeter Result Analysis using Datasette (via) NaveenKumar Namachivayam wrote a detailed tutorial on using Datasette (on Windows) and csvs-to-sqlite to analyze the results of JMeter performance test runs and then publish them online using Vercel.

# 4:42 am / tutorials, datasette

TIL Splitting on commas in SQLite — I had an input string in `x,y,z` format and I needed to split it into three separate values in SQLite. I managed to do it using a confusing combination of the `instr()` and `substr()` functions.
Release datasette-leaflet 0.2.2 — Datasette plugin adding the Leaflet JavaScript library
Release datasette-cluster-map 0.17.1 — Datasette plugin that shows a map for any data with latitude/longitude columns

Feb. 2, 2021

Release datasette-basemap 0.1a — A basemap for Datasette and datasette-leaflet
Release datasette-basemap 0.1a1 — A basemap for Datasette and datasette-leaflet
Release datasette-tiles 0.1 — Mapping tile server for Datasette, serving tiles from MBTiles packages
Release datasette-tiles 0.1.1 — Mapping tile server for Datasette, serving tiles from MBTiles packages
Release datasette-basemap 0.1 — A basemap for Datasette and datasette-leaflet
Release download-tiles 0.1 — Download map tiles and store them in an MBTiles database
Release download-tiles 0.2 — Download map tiles and store them in an MBTiles database
Release datasette-tiles 0.2 — Mapping tile server for Datasette, serving tiles from MBTiles packages
Release datasette 0.54.1 — An open source multi-tool for exploring and publishing data
Release datasette-basemap 0.2 — A basemap for Datasette and datasette-leaflet
Release datasette-tiles 0.3 — Mapping tile server for Datasette, serving tiles from MBTiles packages

Feb. 3, 2021

Release download-tiles 0.3 — Download map tiles and store them in an MBTiles database
Release download-tiles 0.4 — Download map tiles and store them in an MBTiles database

Cleaning Up Your Postgres Database (via) Craig Kerstiens provides some invaluable tips on running an initial check of the health of a PostgreSQL database, by using queries against the pg_statio_user_indexes table to find the memory cache hit ratio and the pg_stat_user_tables table to see what percentage of queries to your tables are using an index.

# 7:32 am / databases, performance, postgresql, craig-kerstiens

Release datasette-tiles 0.4 — Mapping tile server for Datasette, serving tiles from MBTiles packages
TIL Serving MBTiles with datasette-media — The [MBTiles](https://github.com/mapbox/mbtiles-spec) format uses SQLite to bundle map tiles for use with libraries such as Leaflet.

Feb. 4, 2021

Serving map tiles from SQLite with MBTiles and datasette-tiles

Visit Serving map tiles from SQLite with MBTiles and datasette-tiles

Working on datasette-leaflet last week re-kindled my interest in using Datasette as a GIS (Geographic Information System) platform. SQLite already has strong GIS functionality in the form of SpatiaLite and datasette-cluster-map is currently the most downloaded plugin. Most importantly, maps are fun!

[... 1,334 words]

Release datasette-tiles 0.5 — Mapping tile server for Datasette, serving tiles from MBTiles packages
TIL Downloading MapZen elevation tiles — [Via Tony Hirst](https://twitter.com/psychemedia/status/1357280624319553537) I found out about [MapZen's elevation tiles](https://www.mapzen.com/blog/terrain-tile-service/), which encode elevation data in PNG and other formats.

Feb. 6, 2021

Release sqlite-utils 3.4 — Python CLI utility and library for manipulating SQLite databases
Release datasette-jellyfish 1.0 — Datasette plugin adding SQL functions for fuzzy text matching powered by Jellyfish
Release sqlite-utils 3.4.1 — Python CLI utility and library for manipulating SQLite databases
Release datasette-jellyfish 1.0.1 — Datasette plugin adding SQL functions for fuzzy text matching powered by Jellyfish

Feb. 7, 2021

Weeknotes: Mostly messing around with map tiles

Most of what I worked on this week was covered in Serving map tiles from SQLite with MBTiles and datasette-tiles. I built two new plugins: datasette-tiles for serving map tiles, and datasette-basemap which bundles map tiles for zoom levels 0-6 of OpenStreetMap. I also released download-tiles for downloading tiles and bundling them into an MBTiles database.

[... 350 words]

TIL Shrinking PNG files with pngquant and oxipng — I usually use [Squoosh.app](https://squoosh.app/) to reduce the size of my PNGs, but in this case I had a folder with nearly 50 images in it so I wanted to do it using the command-line.

Video introduction to Datasette and sqlite-utils

Visit Video introduction to Datasette and sqlite-utils

I put together a 17 minute video introduction to Datasette and sqlite-utils for FOSDEM 2021, showing how you can use Datasette to explore data, and demonstrating using the sqlite-utils command-line tool to convert a CSV file into a SQLite database, and then publish it using datasette publish. Here’s the video, plus annotated screen captures with further links and commentary.

[... 1,969 words]

2021 » February

MTWTFSS
1234567
891011121314
15161718192021
22232425262728