Items tagged datasette, gitscraping

Filters: datasette × gitscraping × Sorted by date

13 results

Tracking Mastodon user numbers over time with a bucket of tricks

Mastodon is definitely having a moment. User growth is skyrocketing as more and more people migrate over from Twitter.

7 am / 20th November 2022 / github, projects, datasette, observable, githubactions, gitscraping, githistory, s3credentials, datasettelite, mastodon

Measuring traffic during the Half Moon Bay Pumpkin Festival

This weekend was the 50th annual Half Moon Bay Pumpkin Festival.

[... 2693 words]

3:41 pm / 19th October 2022 / datajournalism, projects, sqlite, datasette, gitscraping, githistory, datasettelite, halfmoonbay

Automatically opening issues when tracked file content changes

I figured out a GitHub Actions pattern to keep track of a file published somewhere on the internet and automatically open a new repository issue any time the contents of that file changes.

[... 1211 words]

5:18 pm / 28th April 2022 / github, gzip, projects, python, datasette, asgi, githubactions, gitscraping

Weeknotes: Shaving some beautiful yaks

I’ve been mostly shaving yaks this week—two in particular: the Datasette table refactor and the next release of git-history. I also built and released my first Web Component!

[... 1307 words]

3:43 am / 1st December 2021 / projects, npm, datasette, webcomponents, weeknotes, gitscraping

Weeknotes: Apache proxies in Docker containers, refactoring Datasette

Updates to six major projects this week, plus finally some concrete progress towards Datasette 1.0.

[... 1630 words]

5:43 am / 22nd November 2021 / apache, proxies, refactoring, supervisord, docker, datasette, weeknotes, gitscraping, sqliteutils

Weeknotes: git-history, created for a Git scraping workshop

My main project this week was a 90 minute workshop I delivered about Git scraping at Coda.Br 2021, a Brazilian data journalism conference, on Friday. This inspired the creation of a brand new tool, git-history, plus smaller improvements to a range of other projects.

[... 1239 words]

4:10 am / 15th November 2021 / aws, projects, s3, talks, teaching, datasette, weeknotes, gitscraping, sqliteutils, githistory, s3credentials

Weeknotes: SpatiaLite 5, Datasette on Azure, more CDC vaccination history

This week I got SpatiaLite 5 working in the Datasette Docker image, improved the CDC vaccination history git scraper, figured out Datasette on Azure and we closed on a new home!

[... 986 words]

5:19 am / 28th March 2021 / aws, azure, datasette, weeknotes, gitscraping

Weeknotes: Datasette and Git scraping at NICAR, VaccinateCA

This week I virtually attended the NICAR data journalism conference and made a ton of progress on the Django backend for VaccinateCA (see last week).

[... 773 words]

7:29 am / 7th March 2021 / datajournalism, youtube, datasette, weeknotes, gitscraping, vaccinateca, nicar

Datasette Weekly: Datasette 0.50, git scraping, extracting columns (via) The first edition of the new Datasette Weekly newsletter—covering Datasette 0.50, Git scraping, extracting columns with sqlite-utils and featuring datasette-graphql as the first “plugin of the week” # 10th October 2020, 9 pm

Weeknotes: datasette-auth-passwords, a Datasette logo and a whole lot more

All sorts of project updates this week.

[... 913 words]

3:41 am / 17th July 2020 / design, passwords, projects, datasette, weeknotes, covid19, gitscraping

Weeknotes: Archiving coronavirus.data.gov.uk, custom pages and directory configuration in Datasette, photos-to-sqlite

I mainly made progress on three projects this week: Datasette, photos-to-sqlite and a cleaner way of archiving data to a git repository.

[... 1132 words]

7:41 pm / 29th April 2020 / git, http, matthewsomerville, photos, projects, datasette, weeknotes, covid19, gitscraping

Tracking FARA by deploying a data API using GitHub Actions and Cloud Run

I’m using the combination of GitHub Actions and Google Cloud Run to retrieve data from the U.S. Department of Justice FARA website and deploy it as a queryable API using Datasette.

[... 1599 words]

7:51 am / 21st January 2020 / continuousdeployment, continuousintegration, datajournalism, github, projects, datasette, cloudrun, githubactions, gitscraping