Simon Willison’s Weblog

Subscribe

Items tagged projects, githistory in 2021

Filters: Year: 2021 × projects × githistory × Sorted by date


git-history: a tool for analyzing scraped data collected using Git and SQLite

I described Git scraping last year: a technique for writing scrapers where you periodically snapshot a source of data to a Git repository in order to record changes to that source over time.

[... 2002 words]

10:32 pm / 7th December 2021 / datajournalism, git, projects, scraping, sqlite, datasette, githistory

Weeknotes: git-history, created for a Git scraping workshop

My main project this week was a 90 minute workshop I delivered about Git scraping at Coda.Br 2021, a Brazilian data journalism conference, on Friday. This inspired the creation of a brand new tool, git-history, plus smaller improvements to a range of other projects.

[... 1239 words]

4:10 am / 15th November 2021 / aws, projects, s3, talks, teaching, datasette, weeknotes, gitscraping, sqliteutils, githistory, s3credentials

Types

Years

Months

Tags