Simon Willison’s Weblog

Subscribe

Items tagged datajournalism, githubactions

Filters: datajournalism × githubactions × Sorted by date


Git scraping, the five minute lightning talk

I prepared a lightning talk about Git scraping for the NICAR 2021 data journalism conference. In the talk I explain the idea of running scheduled scrapers in GitHub Actions, show some examples and then live code a new scraper for the CDC’s vaccination data using the GitHub web interface. Here’s the video.

[... 289 words]

12:44 am / 5th March 2021 / datajournalism, scraping, talks, githubactions, gitscraping, annotatedtalks, nicar

Tracking FARA by deploying a data API using GitHub Actions and Cloud Run

I’m using the combination of GitHub Actions and Google Cloud Run to retrieve data from the U.S. Department of Justice FARA website and deploy it as a queryable API using Datasette.

[... 1599 words]

7:51 am / 21st January 2020 / continuousdeployment, continuousintegration, datajournalism, github, projects, datasette, cloudrun, githubactions, gitscraping

Types

Years

Tags