Simon Willison’s Weblog

Subscribe
Atom feed

Elsewhere

Filters: Sorted by date

Release sqlite-utils 3.25.1 — Python CLI utility and library for manipulating SQLite databases
Release shot-scraper 0.4 — A command-line utility for taking automated screenshots of websites
Release shot-scraper 0.3 — A command-line utility for taking automated screenshots of websites
Release shot-scraper 0.2 — A command-line utility for taking automated screenshots of websites
Release shot-scraper 0.1 — A command-line utility for taking automated screenshots of websites
Release shot-scraper 0.1a0 — A command-line utility for taking automated screenshots of websites
Release django-sql-dashboard 1.0.2 — Django app for building dashboards using raw SQL queries
TIL pytest coverage with context — [This tweet](https://twitter.com/mariatta/status/1499863816489734146) from \@Mariatta tipped me off to the ability to measure "contexts" when [running coverage](https://coverage.readthedocs.io/en/6.3.2/contexts.html#context-reporting) - as a way to tell which tests exercise which specific lines of code.
None
TIL Natural Earth in SpatiaLite and Datasette — Natural Earth ([website](https://www.naturalearthdata.com/), [Wikipedia](https://en.wikipedia.org/wiki/Natural_Earth)) is a a public domain map dataset.
None
Release geojson-to-sqlite 1.0 — CLI tool for converting GeoJSON files to SQLite (with SpatiaLite)
Release sqlite-utils 3.25 — Python CLI utility and library for manipulating SQLite databases
Release xml-analyser 1.3 — Simple command line tool for quickly analysing the structure of an arbitrary XML file
Release datasette-dateutil 0.3 — dateutil functions for Datasette
TIL Installing Python on macOS with the official Python installer — I usually use Homebrew on macOS, but I decided to try using the official Python installer based on [this Twitter conversation](https://twitter.com/rtpg_/status/1498115527465914371).
None
TIL Running the latest SQLite in Datasette using Homebrew — I made a pleasant discovery today: Homebrew are very quick to update to the latest SQLite release (here's [their formula](https://github.com/Homebrew/homebrew-core/blob/master/Formula/sqlite.rb)), and since [Datasette](https://datasette.io/) when installed via Homebrew uses that version, this means you can use `brew update sqlite` to ensure you are running the most recent SQLite version within Datasette.
None
TIL Crawling Datasette with Datasette — I wanted to add the new tutorials on https://datasette.io/tutorials to the search index that is used by the https://datasette.io/-/beta search engine.
None
Release datasette-render-markdown 2.1 — Datasette plugin for rendering Markdown
Release datasette-redirect-forbidden 0.1 — Redirect forbidden requests to a login page
TIL Using curl to run GraphQL queries from the command line — I wanted to run a query against the GitHub GraphQL API using `curl` on the command line, while keeping the query itself as readable as possible. Here's the recipe I came up with (tested in both `bash` and `zsh`), with TOKEN replaced by my GitHub API personal access token:
None
Release sqlite-diffable 0.2.1 — Tools for dumping/loading a SQLite database to diffable directory structure
Release google-drive-to-sqlite 0.4 — Create a SQLite database containing metadata from Google Drive
Release google-drive-to-sqlite 0.3 — Create a SQLite database containing metadata from Google Drive
Release google-drive-to-sqlite 0.2a0 — Create a SQLite database containing metadata from Google Drive
Release google-drive-to-sqlite 0.1a2 — Create a SQLite database containing metadata from Google Drive
Release google-drive-to-sqlite 0.1a1 — Create a SQLite database containing metadata from Google Drive
TIL Recursively fetching metadata for all files in a Google Drive folder — For [google-drive-to-sqlite](https://github.com/simonw/google-drive-to-sqlite) I wanted a mechanism to recursively return metadata on every file in a specified Goole Drive folder.
None
TIL Google OAuth for a CLI application — > :warning: The OOB flow described in this document has been [scheduled for deprecation](https://developers.googleblog.com/2022/02/making-oauth-flows-safer.html?m=1#disallowed-oo) by Google. See [issue #39](https://github.com/simonw/google-drive-to-sqlite/issues/39) for notes on how to replace it.
None
Release google-drive-to-sqlite 0.1a0 — Create a SQLite database containing metadata from Google Drive
TIL Combining substr and instr to extract text — Derek Willis has [a Datasette instance full of political campaign emails](https://political-emails.herokuapp.com/) running on Heroku.
None
Release sqlite-utils 3.24 — Python CLI utility and library for manipulating SQLite databases