Simon Willison’s Weblog

Subscribe
Atom feed

Blogmarks

Filters: Sorted by date

Nmap 5.00 Release Notes. Released today, “the most important Nmap release since 1997”. New features include Ncat, a powerful netcat alternative, Ndiff, a utility for comparing scan results so you can spot changes to your network, and a new Nmap Scripting Engine using Lua.

# 16th July 2009, 7:40 pm / lua, ncat, ndiff, netcat, nmap, releases, security, tools

Curating conversations. Chris Thorpe has open-sourced the Guardian’s moderated Twitter backchannel app, for displaying back channels at high profile (and hence high potential for abuse) events. It’s a Python application that runs on App Engine.

# 16th July 2009, 7:34 pm / chris-thorpe, google-app-engine, guardian, python, twitter

IanVisits: London Events Calendar. Ian Mansfield maintains a superb calendar of cultural (and geeky) events in London. Lectures, tours, bat walks, film screenings... did you know there’s a Festival of Model Tramways this weekend?

# 16th July 2009, 7:22 pm / calendar, events, ian-mansfield, ian-visits, london

Keyspace. Yet Another Key-Value Store—this one focuses on high availability, with one server in the cluster serving as master (and handling all writes), and the paxos algorithm handling replication and ensuring a new master can be elected should the existing master become unavailable. Clients can chose to make dirty reads against replicated servers or clean reads by talking directly to the master. Underlying storage is BerkeleyDB, and the authors claim 100,000 writes/second. Released under the AGPL.

# 16th July 2009, 10:30 am / agpl, berkeleydb, databases, keyspace, keyvaluepairs, paxos, replication, scaling

Google’s Chiller-less Data Center. Google are operating an outside data center in Belgium with no chillers (refrigeration units used to cool water, but at a high cost in energy) making “local weather forecasting a larger factor in its data center management”. On the 10 or so days of the year when Belgium is too warm, they can simply shut down the data center and shift the workload elsewhere.

# 16th July 2009, 9:50 am / chillers, cooling, datacenters, energy, environment, google

You should follow me on Twitter. Dustin Curtis did a simple A/B testing experiment on his blog and found that the text “you should follow me on Twitter” had the highest click-through rate—173% more effective than “I’m on Twitter”.

# 15th July 2009, 10:43 am / ab-testing, buckettesting, copy, dustin-curtis, twitter

Slouching towards Bethlehem. Photos of the various installations that contributed to the construction of the first atom bomb.

# 15th July 2009, 10:19 am / atombomb, history, nuclear, photos

Meta Is Murder. I hadn’t realised how important MetaTalk was in ensuring high quality discussions on MetaFilter, by ensuring that meta-discussions happened somewhere else. Speaking of which, happy birthday MetaFilter.

# 14th July 2009, 7:34 pm / blogging, jeff-atwood, metadiscussions, metafilter, metatalk

Twenty questions about the GPL. Jacob kicks off a fascinating discussion about GPLv3.

# 13th July 2009, 11:59 pm / gpl, gpl3, jacob-kaplan-moss, licensing, open-source

HTML 5 Parsing. Firefox nightlies include a new parser that implements the HTML5 parsing algorithm (disabled by default), which uses C++ code automatically generated from Henri Sivonen’s Java parser first used in the HTML5 validator.

# 11th July 2009, 11:36 pm / browsers, firefox, henri-sivonen, html5, john-resig, mozilla, parsing, validator

Google Will Eat Itself. “We generate money by serving Google text advertisments on a network of hidden Websites. With this money we automatically buy Google shares. We buy Google via their own advertisment!”

# 10th July 2009, 12:15 pm / clickfraud, google

Social Media Icons. Paul Robert Lloyd: “ In the past I’ve used site favicons, but these can often be visually inconsistent”—so he’s put together a tasty set of icons for different social websites with a consistent visual feel, available in four different sizes.

# 9th July 2009, 4:38 pm / design, icons, paul-robert-lloyd, social-media

App Engine outage postmortem. Interesting peek behind the scenes. The primary cause of the error was a bug in a GFS (Google File System) Master server caused by a MapReduce process sending a malformed filehandle, reminiscent of the error which took down S3 last year.

# 9th July 2009, 12:49 pm / downtime, gfs, google, google-app-engine, s3, postmortem

Tools of the Modern Python Hacker: Virtualenv, Fabric and Pip. Ashamed to say I’m not using any of these yet—for Django projects, my manage.py inserts an “ext” directory at the beginning of the Python path which contains my dependencies for that project.

# 9th July 2009, 11:40 am / deployment, django, fabric, pip, python, pythonpath, tools, virtualenv

Desktop Couch initial code. More from Stuart Langridge on the project to make CouchDB available as a desktop service, providing free synchronisation between machines and a way for different applications to interrogate each other’s structured data.

# 9th July 2009, 11:34 am / couchdb, desktop, stuart-langridge, synchronisation

YQL: INSERT INTO internet. insert into twitter.status (status,username,password) values (“Playing with INSERT, UPDATE and DELETE in YQL”, “twitterusername”,“twitterpassword”)

# 8th July 2009, 8:19 pm / apis, sql, twitter, yahoo, yql

Scope. Matt Webb’s opening keynote at this year’s reboot11. You owe it to yourself to read it.

# 8th July 2009, 8:15 pm / matt-webb, reboot, scope, my-talks

John Resig on Glow. John criticises Glow for reinventing the wheel—BBC insiders respond in the comments below.

# 8th July 2009, 7:24 pm / bbc, glow, javascript, john-resig, libraries

BBC: Glow (via) The BBC have released Glow, their jQuery-like JavaScript library developed in house over the past few years. It’s open source under the Apache license.

# 8th July 2009, 3:25 pm / bbc, glow, javascript, jquery, open-source

Solved: where the civil servant really wrote that message to Hazel Blears. There’s an interesting usability / understanding-of-technology story here.

# 7th July 2009, 5:41 pm / theyworkforyou, usability

In defense of web developers. Zeldman: “The social benefit of rethinking markup sealed the deal. XHTML’s introduction in 2000, and its emphasis on rules of construction, gave web standards evangelists like me a platform on which to hook a program of semantic markup replacing the bloated and unsustainable tag soup of the day.”

# 7th July 2009, 3:52 pm / html5, jeffrey-zeldman, markup, web-standards, xhtml

Yahoo! proposal to open source “Traffic Server” via the ASF. Traffic Server is a “fast, scalable and extensible HTTP/1.1 compliant caching proxy server” (presumably equivalent to things like Squid and Varnish) originally acquired from Inktomi and developed internally at Yahoo! for the past three years, which has been benchmarked handling 35,000 req/s on a single box. No source code yet but it looks like the release will arrive pretty soon.

# 7th July 2009, 12:37 pm / apache, asf, caching, open-source, proxies, squid, trafficserver, varnish, yahoo

Up and running with Cassandra. Twitter are beginning to use Cassandra, the open source branch of Facebook’s BigTable-like non-relational database. Evan Weaver explains how to get started with it, but warns that it’s not yet a good idea to trust data to it without having a full backup in an unrelated storage engine.

# 7th July 2009, 11:18 am / bigtable, cassandra, evanweaver, facebook, nonrelationaldatabases, scaling, twitter

From Microsoft: C# and CLI under the Community Promise. Microsoft’s assurance that it won’t “assert its Necessary Claims” against alternative (including open source) implementations of the ECMA C# and CLR specifications. The promise doesn’t cover implementations of .NET, WinForms etc- so the Mono team have announced they will be splitting their project in to two packages—a safe, ECMA based package and a package containing everything else.

# 7th July 2009, 11:15 am / aspdotnet, cli, csharp, ecma, microsoft, miguel-de-icaza, mono, open-source, patents

Stellarium. Really lovely open source planetarium application, for Linux, OS X and Windows.

# 7th July 2009, 12:37 am / open-source, planetarium, space, stellarium

Tips on using python’s datetime module. Wow. I’ve run in to problems with datetime and timezones before, but I had no idea how intrinsic those problems were to the design of the library.

# 6th July 2009, 2:20 pm / dates, datetime, python, times

Evidence of OpenID at Amazon. It looks like Amazon are using OpenID for SSO between their different properties—I clicked a link to sign in to AWS and the URL had OpenID query string parameters.

# 6th July 2009, 1:25 am / amazon, aws, openid, sso

Jeffrey Zeldman: XHTML WTF. Reading the comments, it’s scary how many people are totally ill-informed about HTML5 and XHTML5.

# 4th July 2009, 1:22 am / education, html5, jeffrey-zeldman, web-standards, xhtml, xhtml5

FAQs about the future of XHTML. The XHTML 2 Working Group charter will not be renewed after 2009—as far as the W3C are concerned, XHTML5 is the future of XHTML.

# 3rd July 2009, 1:37 am / w3c, web-standards, xhtml, xhtml2, xhtml5

Years

Tags