Entries tagged gitscraping in 2020

Filters: Type: entry × Year: 2020 × gitscraping × Sorted by date

5 results

Weeknotes: sqlite-utils 3.0 alpha, Git scraping in the zeitgeist

Natalie and I decided to escape San Francisco for election week, and have been holed up in Fort Bragg on the Northern California coast. I’ve mostly been on vacation, but I did find time to make some significant changes to sqlite-utils. Plus notes on an exciting Git scraping project.

[... 603 words]

2:17 am / 7th November 2020 / alexgaynor, elections, weeknotes, gitscraping, sqliteutils

Git scraping: track changes over time by scraping to a Git repository

Git scraping is the name I’ve given a scraping technique that I’ve been experimenting with for a few years now. It’s really effective, and more people should use it.

[... 963 words]

6:27 pm / 9th October 2020 / git, github, projects, scraping, githubactions, gitscraping

Weeknotes: datasette-auth-passwords, a Datasette logo and a whole lot more

All sorts of project updates this week.

[... 913 words]

3:41 am / 17th July 2020 / design, passwords, projects, datasette, weeknotes, covid19, gitscraping

Weeknotes: Archiving coronavirus.data.gov.uk, custom pages and directory configuration in Datasette, photos-to-sqlite

I mainly made progress on three projects this week: Datasette, photos-to-sqlite and a cleaner way of archiving data to a git repository.

[... 1132 words]

7:41 pm / 29th April 2020 / git, http, matthewsomerville, photos, projects, datasette, weeknotes, covid19, gitscraping

Tracking FARA by deploying a data API using GitHub Actions and Cloud Run

I’m using the combination of GitHub Actions and Google Cloud Run to retrieve data from the U.S. Department of Justice FARA website and deploy it as a queryable API using Datasette.

[... 1599 words]

7:51 am / 21st January 2020 / continuousdeployment, continuousintegration, datajournalism, github, projects, datasette, cloudrun, githubactions, gitscraping

Simon Willison’s Weblog