Simon Willison’s Weblog

Subscribe

Friday, 6th November 2020

nyt-2020-election-scraper. Brilliant application of git scraping by Alex Gaynor and a growing team of contributors. Takes a JSON snapshot of the NYT’s latest election poll figures every five minutes, then runs a Python script to iterate through the history and build an HTML page showing the trends, including what percentage of the remaining votes each candidate needs to win each state. This is the perfect case study in why it can be useful to take a “snapshot if the world right now” data source and turn it into a git revision history over time.

# 2:24 pm / elections, alex-gaynor, git-scraping, data-journalism, git, new-york-times

2020 » November

MTWTFSS
      1
2345678
9101112131415
16171819202122
23242526272829
30