Items tagged weeknotes, gitscraping

Filters: weeknotes × gitscraping × Sorted by date

10 results

Help scraping: track changes to CLI tools by recording their --help using Git

I’ve been experimenting with a new variant of Git scraping this week which I’m calling Help scraping. The key idea is to track changes made to CLI tools over time by recording the output of their --help commands in a Git repository.

[... 978 words]

11:46 pm / 2nd February 2022 / git, github, projects, scraping, graphql, weeknotes, githubactions, gitscraping, fly

Weeknotes: Shaving some beautiful yaks

I’ve been mostly shaving yaks this week—two in particular: the Datasette table refactor and the next release of git-history. I also built and released my first Web Component!

[... 1307 words]

3:43 am / 1st December 2021 / projects, npm, datasette, webcomponents, weeknotes, gitscraping

Weeknotes: Apache proxies in Docker containers, refactoring Datasette

Updates to six major projects this week, plus finally some concrete progress towards Datasette 1.0.

[... 1630 words]

5:43 am / 22nd November 2021 / apache, proxies, refactoring, supervisord, docker, datasette, weeknotes, gitscraping, sqliteutils

Weeknotes: git-history, created for a Git scraping workshop

My main project this week was a 90 minute workshop I delivered about Git scraping at Coda.Br 2021, a Brazilian data journalism conference, on Friday. This inspired the creation of a brand new tool, git-history, plus smaller improvements to a range of other projects.

[... 1239 words]

4:10 am / 15th November 2021 / aws, projects, s3, talks, teaching, datasette, weeknotes, gitscraping, sqliteutils, githistory, s3credentials

Weeknotes: CDC vaccination history fixes, developing in GitHub Codespaces

I spent the last week mostly surrounded by boxes: we’re completing our move to the new place and life is mostly unpacking now. I did find some time to fix some issues with my CDC vaccination history Datasette instance though.

[... 514 words]

1:53 am / 28th September 2021 / github, projects, weeknotes, covid19, gitscraping, githubcodespaces

Weeknotes: SpatiaLite 5, Datasette on Azure, more CDC vaccination history

This week I got SpatiaLite 5 working in the Datasette Docker image, improved the CDC vaccination history git scraper, figured out Datasette on Azure and we closed on a new home!

[... 986 words]

5:19 am / 28th March 2021 / aws, azure, datasette, weeknotes, gitscraping

Weeknotes: Datasette and Git scraping at NICAR, VaccinateCA

This week I virtually attended the NICAR data journalism conference and made a ton of progress on the Django backend for VaccinateCA (see last week).

[... 773 words]

7:29 am / 7th March 2021 / datajournalism, youtube, datasette, weeknotes, gitscraping, vaccinateca, nicar

Weeknotes: sqlite-utils 3.0 alpha, Git scraping in the zeitgeist

Natalie and I decided to escape San Francisco for election week, and have been holed up in Fort Bragg on the Northern California coast. I’ve mostly been on vacation, but I did find time to make some significant changes to sqlite-utils. Plus notes on an exciting Git scraping project.

[... 603 words]

2:17 am / 7th November 2020 / alexgaynor, elections, weeknotes, gitscraping, sqliteutils