Simon Willison’s Weblog

9th October 2007 - Link Blog

Writing An Hadoop MapReduce Program In Python. Hadoop (the open source map/reduce framework) can interact with any program that reads from stdin and outputs on stdout—so it’s trivial to drop in Python scripts for the map and reduce steps.

Posted 9th October 2007 at 11:33 am

Recent articles

Publishing WASM wheels to PyPI for use with Pyodide - 13th June 2026
Claude Fable is relentlessly proactive - 11th June 2026
Initial impressions of Claude Fable 5 - 9th June 2026

This is a link post by Simon Willison, posted on 9th October 2007.

hadoop 9 mapreduce 10 python 1,261

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe