Simon Willison’s Weblog

Blogmarks tagged scaling, memcache, python in Jan

Filters: Type: blogmark × Month: Jan × scaling × memcache × python ×


Sharding Counters on Google App Engine. “While the datastore for App Engine scales to support a huge number of entities it is important to note that you can only expect to update any single entity, or entity-group, about five times a second”. This article explains a technique for sharding writes across multiple counters in detail, including a way to keep a memcache counter updated at the same time for faster reads. # 27th January 2009, 8:27 pm