Weeknotes: AI hacking and a SpatiaLite tutorial

15th January 2023

Short weeknotes this time because the key things I worked on have already been covered here:

How to implement Q&A against your documentation with GPT3, embeddings and Datasette described my experiment using custom SQL functions in Datasette to provide a Q&A interface against an existing corpus of documents. This resulted in a flurry of software releases:
- datasette-openai—custom SQL functions for querying the OpenAI APIs from Datasette
- datasette-faiss—a plugin that builds a FAISS index for fast vector similarity search
- datasette-cookies-for-magic-parameters—a supporting plugin that helps store secrets such as API keys in cookies so they won’t be transmitted in query strings
- openai-to-sqlite—a command-line tool for storing OpenAI API responses in a SQLite database—useful for calculating embeddings
Datasette 0.64, with a warning about SpatiaLite—I released Datasette 0.64 with a new --setting default_allow_sql off setting, due to the discovery that some of the SQL functions added by the SpatiaLite module can be used to crash the Datasette instance.
Building a location to time zone API with SpatiaLite is the latest in the official series of tutorials for Datasette. It demonstrates how SpatiaLite can be used to safely build and deploy a geospatial API.

datasette-openai: 0.2—(4 releases total)—2023-01-14
SQL functions for calling OpenAI APIs
openai-to-sqlite: 0.2—(2 releases total)—2023-01-13
Save OpenAI API results to a SQLite database
datasette-cookies-for-magic-parameters: 0.1.2—(3 releases total)—2023-01-12
UI for setting cookies to populate magic parameters
git-history: 0.7a0—(10 releases total)—2023-01-11
Tools for analyzing Git history using SQLite
datasette: 0.64.1—(124 releases total)—2023-01-11
An open source multi-tool for exploring and publishing data
datasette-faiss: 0.1a0—2023-01-11
Maintain a FAISS index for specified Datasette tables
json-to-files: 0.1—2023-01-10
Create separate files on disk based on a JSON object
datasette-auth-passwords: 1.1—(12 releases total)—2023-01-09
Datasette plugin for authentication using passwords
datasette-publish-fly: 1.3—(9 releases total)—2023-01-09
Datasette plugin for publishing data using Fly
shapefile-to-sqlite: 0.4.2—(6 releases total)—2023-01-08
Load shapefiles into a SQLite (optionally SpatiaLite) database

Simon Willison’s Weblog