Elsewhere

TIL Extracting objects recursively with jq — The Algolia-powered Hacker News API returns nested comment threads that look like this: https://hn.algolia.com/api/v1/items/27941108

25th Jul 2021, 3:58 am

Release sqlite-transform 1.2 — Tool for running transformations on columns in a SQLite database

25th Jul 2021, 1:02 am

Release sqlite-utils 3.13 — Python CLI utility and library for manipulating SQLite databases

24th Jul 2021, 10:17 pm · sqlite, sqlite-utils

Release sqlite-transform 1.1 — Tool for running transformations on columns in a SQLite database

21st Jul 2021, 7:05 pm

Release sqlite-transform 1.0 — Tool for running transformations on columns in a SQLite database

21st Jul 2021, 1:05 am

TIL Using the tesseract CLI tool — Tesseract OCR has a command-line utility which is woefully under-documented. Thanks to [Alexandru Nedelcu](https://alexn.org/blog/2020/11/11/organize-index-screenshots-ocr-macos.html) I figured out how to use it today.

18th Jul 2021, 4:56 pm

Release datasette-export-notebook 1.0 — Datasette plugin providing instructions for exporting data to Jupyter or Observable

17th Jul 2021, 4:01 am · datasette

Release datasette-graphql 1.5 — Datasette plugin providing an automatic GraphQL API for your SQLite databases

16th Jul 2021, 8:03 pm · datasette

Release datasette 0.58.1 — An open source multi-tool for exploring and publishing data

16th Jul 2021, 7:51 pm · datasette

Release datasette 0.58 — An open source multi-tool for exploring and publishing data

15th Jul 2021, 12:37 am · datasette

TIL Importing CSV data into SQLite with .import — I usually use my `sqlite-utils insert blah.db tablename file.csv --csv` command to import CSV data into SQLite, but for large CSV files (like a 750MB one) this can take quite a long time - over half an hour in this case.

14th Jul 2021, 5:01 am

Release conditional-get 0.3 — CLI tool for fetching data using HTTP conditional get

14th Jul 2021, 3:28 am

TIL Using nginx to proxy to a Unix domain socket — I figured this out while adding `--uds` support to Datasette in [#1388](https://github.com/simonw/datasette/issues/1388). Save the following in `nginx.conf`:

11th Jul 2021, 1:12 am

TIL Using pysqlite3 on macOS — While trying to use [pysqlite3](https://github.com/coleifer/pysqlite3) on macOS I got the following error:

10th Jul 2021, 7:21 pm

TIL Increasing the time limit for a Google Cloud Scheduler task — In [VIAL issue 724](https://github.com/CAVaccineInventory/vial/issues/724) a Cloud Scheduler job which triggered a Cloud Run hosted export script - by sending an HTTP POST to an endpoint - was returning an error. The logs showed the error happened exactly three minutes after the task started executing.

9th Jul 2021, 12:38 am

TIL Preventing double form submissions with JavaScript — I needed this for [VIAL issue 722](https://github.com/CAVaccineInventory/vial/issues/722). I decided to disable form submissions for two seconds after they are submitted, to protect against accidental double submissions without risk of unexpected issues that could cause the form to be permanently disabled even though it should still be able to submit it.

8th Jul 2021, 9:53 pm

TIL Installing different PostgreSQL server versions in GitHub Actions — The GitHub Actions `ubuntu-latest` default runner currently includes an installation of PostgreSQL 13. The server is not running by default but you can interact with it like this:

6th Jul 2021, 12:43 am

Release django-sql-dashboard 1.0.1 — Django app for building dashboards using raw SQL queries

6th Jul 2021, 12:37 am

Release django-sql-dashboard 1.0 — Django app for building dashboards using raw SQL queries

1st Jul 2021, 3:58 am

Release sqlite-utils 3.12

New db.query(sql, params) method, which executes a SQL query and returns the results as an iterator over Python dictionaries. (#290)

This project now uses flake8 and has started to use mypy. (#291)

New documentation on contributing to this project. (#292)

25th Jun 2021, 6 pm · sqlite, sqlite-utils

Release datasette 0.58a1 — An open source multi-tool for exploring and publishing data

24th Jun 2021, 4:29 pm · datasette

Release asgi-csrf 0.9 — ASGI middleware for protecting against CSRF attacks

23rd Jun 2021, 7:35 pm

TIL Scraping Reddit via their JSON API — Reddit have long had an unofficial (I think) API where you can add `.json` to the end of any URL to get back the data for that page as JSON.

21st Jun 2021, 9:01 pm

Release sqlite-utils 3.11 — Python CLI utility and library for manipulating SQLite databases

20th Jun 2021, 6:53 pm · sqlite, sqlite-utils

TIL Mouse support in vim — Today I learned that if you hit `Esc` in vim and then type `:set mouse=a` and hit enter... vim grows mouse support! In your terminal!

19th Jun 2021, 9:57 pm

Release sqlite-utils 3.10 — Python CLI utility and library for manipulating SQLite databases

19th Jun 2021, 4:13 pm · sqlite, sqlite-utils

Release dogsheep-beta 0.10.2 — Build a search index across content from multiple SQLite database tables and run faceted searches against it using Datasette

13th Jun 2021, 2:38 pm

Release yaml-to-sqlite 1.0 — Utility for converting YAML files to SQLite

13th Jun 2021, 4:45 am · sqlite, yaml

Release markdown-to-sqlite 1.0 — CLI tool for loading markdown files into a SQLite database

13th Jun 2021, 4:17 am

Release sqlite-utils 3.9.1 — Python CLI utility and library for manipulating SQLite databases

13th Jun 2021, 3 am · sqlite, sqlite-utils

Simon Willison’s Weblog

Elsewhere

Beats

Years

Tags