21st September 2024
TIL
How streaming LLM APIs work
— I decided to have a poke around and see if I could figure out how the HTTP streaming APIs from the various hosted LLM providers actually worked. Here are my notes so far.
Recent articles
- Some thoughts on the Navier–Stokes Millennium Prize Problem - 8th September 2026
- The Pelican comparison grid for Astra is pretty interesting - 4th September 2026
- OpenAI's rogue agents were caught communicating via public wikis - 4th September 2026