Some Notes on Tim Bray's Wide Finder Benchmark. Fredrik Lundh demonstrates some Python ninja techniques for parsing log files using multiple cores (and eventually memory mapping).
Sign in with 
OpenID
Some Notes on Tim Bray's Wide Finder Benchmark. Fredrik Lundh demonstrates some Python ninja techniques for parsing log files using multiple cores (and eventually memory mapping).
You can pretty easily port his threaded version (wf-4.py) over to the processing module and get something as fast as his final version. Plus, the version using the processing module is much easier to read.
See http://mtrr.org/blog/?p=91 for details.
Stanley Seibert - 7th October 2007 07:56 - #