Simon Willison’s Weblog

A brief update with some numbers for hardware load-balanced mongrels. 4000 requests/second on 48 mongrels behind a hardware load balancer.

Posted 5th February 2007 at 12:38 am

Recent articles

The Summer of Johann: prompt injections as far as the eye can see - 15th August 2025
Open weight LLMs exhibit inconsistent performance across providers - 15th August 2025
LLM 0.27, the annotated release notes: GPT-5 and improved tool calling - 11th August 2025

mongrel 3 rails 72 scaling 143

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe