Simon Willison’s Weblog

Subscribe
Atom feed for datasette Random

1,478 posts tagged “datasette”

Datasette is an open source tool for exploring and publishing data.

2025

Release datasette-acl 0.5a0 — Advanced permission management for Datasette
Release datasette-allow-permissions-debug 0.2a0 — Always allow access to /-/permissions, for debugging
Release datasette-events-forward 0.1a3 — Forward Datasette analytical events on to another Datasette instance
Release datasette-search-all 1.1.5a0 — Datasette plugin for searching all searchable tables at once
Release datasette 1.0a20 — An open source multi-tool for exploring and publishing data
Release datasette-events-forward 0.1a2 — Forward Datasette analytical events on to another Datasette instance
Release datasette-debug-actors-from-ids 0.1a2 — Datasette plugin for trying out the actors_from_ids hook
Release datasette-visible-internal-db 0.1.1a1 — Datasette plugin for making the internal database visible for debugging
Release datasette-create-view 0.1a1 — Create a SQL view from a query
Release datasette-studio 0.1a5 — Datasette pre-configured with useful plugins. Experimental alpha.
Release datasette-load 0.1a4 — API and UI for bulk loading data into Datasette from a URL
Release datasette-import 0.1a6 — Tools for importing data into Datasette
Release datasette-events-db 0.1a1 — Log Datasette events to a database table
Release datasette-public 0.3a4 — Make selected Datasette databases and tables visible to the public
Release datasette-edit-schema 0.8a4 — Datasette plugin for modifying table schemas
Release datasette-remote-actors 0.1a6 — Datasette plugin for fetching details of actors from a remote endpoint
Release datasette-extract 0.1a11 — Import unstructured data (text and images) into structured tables
Release datasette-pins 0.1a5 — Pin databases, tables, and other items to the Datasette homepage
Release datasette-checkbox 0.1a3 — Add interactive checkboxes to columns in Datasette
Release datasette-column-sum 0.1a1 — Sum the values in numeric Datasette columns
Release datasette-remove-database 0.1a1 — Remove a database from Datasette
Release datasette-queries 0.1.2a1 — Save SQL queries in Datasette
Release datasette-llm-usage 0.1a1 — Track usage of LLM tokens in a SQLite table
Release datasette-enrichments-llm 0.1a1 — Enrich data by prompting LLMs
Release datasette-debug-events 0.1a1 — Print Datasette events to standard error
Release datasette-acl 0.4a5 — Advanced permission management for Datasette

Claude can write complete Datasette plugins now

This isn’t necessarily surprising, but it’s worth noting anyway. Claude Sonnet 4.5 is capable of building a full Datasette plugin now.

[... 1,296 words]

Two of my public Datasette instances - for my TILs and my blog's backup mirror - were getting hammered with misbehaving bot traffic today. Scaling them up to more Fly instances got them running again but I'd rather not pay extra just so bots can crawl me harder.

The log files showed the main problem was facets: Datasette provides these by default on the table page, but they can be combined in ways that keep poorly written crawlers busy visiting different variants of the same page over and over again.

So I turned those off. I'm now running those instances with --setting allow_facet off (described here), and my logs are full of lines that look like this. The "400 Bad Request" means a bot was blocked from loading the page:

GET /simonwillisonblog/blog_entry?_facet_date=created&_facet=series_id&_facet_size=max&_facet=extra_head_html&_sort=is_draft&created__date=2012-01-30 HTTP/1.1" 400 Bad Request

# 6th October 2025, 12:56 am / crawling, datasette