Weeknotes: a livestream, a surprise keynote and progress on Datasette Cloud billing

2024-07-02T04:46:44+00:00

My first YouTube livestream with Val Town, a keynote at the AI Engineer World's Fair and some work integrating Stripe with Datasette Cloud. Plus a bunch of upgrades to my blog.

Livestreaming RAG with Steve Krouse and Val Town

A couple of weeks ago I broadcast a livestream with Val Town founder Steve Krouse, which I then turned into an annotated video write-up.

Outside of a few minutes in the occasional workshop I haven't ever participated in an extended live coding session before. Steve has been running a series of them where he live codes with different guests, and I was excited to be invited to join him.

I really enjoyed it, and I think the end-result was very worthwhile. We built an implementation of RAG against my blog, demonstrating the RAG technique where you extract keywords from the user's question, search for them using a BM25 full-text search index (in this case SQLite FTS) and construct an answer using the search results.

The more time I spend with this RAG pattern the more I like it. It's considerably easier to reason about than RAG using vector search based on embeddings, and can provide high quality results with a relatively simple implementation.

It's often much easier to bake FTS on to an existing site than embedding search, since it avoids the need to run embedding models against thousands of documents and then create a vector search index to run the queries against.

We also got to try out the launched-that-day Claude 3.5 Sonnet, which has quickly become my absolute favourite LLM.

Full details (and video) in my write-up: Building search-based RAG using Claude, Datasette and Val Town.

A surprise keynote

At lunchtime on Wednesday last week I was asked if I could give the opening keynote at the AI Engineer World's Fair... on Thursday morning! Their keynote speaker from OpenAI had to cancel at the last minute and they needed someone who could put together a talk on very short notice.

I gave the closing keynote at their previous event last October - Open questions for AI engineering - so the natural theme for this talk was to review advances in the field in the past 8 month and use those to pose a new set of open challenges for engineers in the room.

I continue to go by the rule of thumb that you need ten hours preparation for every hour on stage... and this was only a twenty minute slot, so I had just about enough time to pull it together!

You can watch the result (and read the accompanying notes) at Open challenges for AI engineering. I'm really happy with it - I got great feedback from attendees during the event and I think I managed to capture the most interesting developments in the field as well as challenging the audience to consider their responsibilities in helping shape what we build next.

Stripe integration for Datasette Cloud

Datasette Cloud has been in preview mode for a while at this point. I'm ready to start billing people, and I've set a target of the end of July to get that in place.

I'm using Stripe for billing, and attempting to outsource as much of the UI complexity of managing subscriptions to their customer portal product as possible.

This has already resulted in one TIL: Mocking Stripe signature checks in a pytest fixture - and I imagine there will be several more before I have everything working smoothly.

JSON API improvements for Datasette 1.0

Alex and I have been using Datasette Cloud to help drive progress towards the Datasette 1.0 release. Datasette Cloud needs a stable JSON API, so we've been working on finalizing the JSON API that will be included in Datasette 1.0.

We worked together on a final design for this which Alex documented in #2360: Datasette JSON API changes for 1.0. He's working on the implementation now, which we hope to land and then ship as an alpha as soon as it's ready for people to try out.

Claude 3.5 Sonnet

I mentioned this above, but it's worth emphasizing quite how much value I've been getting out of Claude 3.5 Sonnet since it's release on the 20th of June. It is so good at writing code! I've also been thoroughly enjoying the new artifacts feature where it can write and then display HTML/CSS/JavaScript - I've used that for several prototyping projects as well as quite a sophisticated animated visualization I used in my keynote last week.

llm-claude-3 0.4 has support for the new model, and I really need to upgrade some of my LLM-powered Datasette plugins to take advantage of it too.

Upgrades to my blog

Last weeknotes I talked about redesigning my homepage and adding entry images and tag descriptions.

I've since made a bunch of smaller incremental improvements around here:

I added support for Markdown in quotations, for example the italics in this quotation of Terry Pratchett.
Tags are now displayed on the homepage (and other pages) for bookmarks and quotations, in addition to entries. This makes my tagging system a lot more prominent, so I've added descriptions to a bunch more tags.
I created 2003.simonwillison.net (#452), a special templated version of my homepage designed to imitate my site's design in 2003 (CSS rescued from the Internet Archive). I have my reasons.
I redesigned the tag clouds on my year archive pages - e.g. on 2024. I actually used Claude 3.5 Sonnet for this - I gave it a screenshot of the tags and asked it to come up with a more tasteful palette of colours.

Here's that new, slightly more tasteful tag cloud:

Releases

datasette 0.64.8 - 2024-06-21
An open source multi-tool for exploring and publishing data
llm-claude-3 0.4 - 2024-06-20
LLM plugin for interacting with the Claude 3 family of models

TILs

Mocking Stripe signature checks in a pytest fixture - 2024-07-02
Running Prettier against Django or Jinja templates - 2024-06-20

Tags: blogging, datasette, weeknotes, datasette-cloud, stripe

Quoting Michael Schade

2023-11-05T22:53:49+00:00

One of my fav early Stripe rules was from incident response comms: do not publicly blame an upstream provider. We chose the provider, so own the results—and use any pain from that as extra motivation to invest in redundant services, go direct to the source, etc.

— Michael Schade

Tags: ops, stripe

Stripe: Online migrations at scale

2023-11-05T16:06:32+00:00

Stripe: Online migrations at scale

This 2017 blog entry from Jacqueline Xu at Stripe provides a very clear description of the “dual writes” pattern for applying complex data migrations without downtime: dual write to new and old tables, update the read paths, update the write paths and finally remove the now obsolete data—illustrated with an example of upgrading customers from having a single to multiple subscriptions.

Via @eatonphil

Tags: databases, migrations, zero-downtime, stripe

Scaling a High-traffic Rate Limiting Stack With Redis Cluster

2018-04-26T18:34:25+00:00

Scaling a High-traffic Rate Limiting Stack With Redis Cluster

Brandur Leach describes the simple, elegant and performant design of Redis Cluster, and talks about how Stripe used it to scaled their rate-limiting from one to ten nodes.

Tags: rate-limiting, redis, scaling, brandur-leach, stripe

Implementing Stripe-like Idempotency Keys in Postgres

2017-10-27T17:51:52+00:00

Implementing Stripe-like Idempotency Keys in Postgres

Having clients send “idempotency keys” with API requests in order to be able to safely retry them if something’s goes wrong is a really neat trick for making transactional APIs more robust. Here Brandur Leach talks implementation strategies.

Via Hacker News

Tags: api-design, idempotency, postgresql, brandur-leach, stripe

What is the best payment provider for a web app with monthly subscription fees at its early stage?

2014-02-20T17:35:00+00:00

My answer to What is the best payment provider for a web app with monthly subscription fees at its early stage? on Quora

We found Stripe extremely easy to get started with for charging subscription payments.

Tags: startups, webapps, quora, stripe

What are the best set of marketing/payment tools for use in startup with a subscription webapp?

2013-12-05T09:28:00+00:00

My answer to What are the best set of marketing/payment tools for use in startup with a subscription webapp? on Quora

Stripe has excellent support for subscription payments, including helping manage recurring payments and pro-rataing for upgrades to plans half way through a billing cycle etc. I believe BrainTree offers similar tools.

For email stuff, I strongly recommend looking in to Mailgun - they offer fantastic tools for advanced email sending. They don't have the same user-level engagement tools as something like Mixpanel or Intercom though.