Simon Willison’s Weblog

Subscribe

Items tagged sqliteutils, shotscraper

Filters: sqliteutils × shotscraper × Sorted by date


Weeknotes: DevDay, GitHub Universe, OpenAI chaos

Three weeks of conferences and Datasette Cloud work, four days of chaos for OpenAI.

[... 766 words]

4:20 am / 22nd November 2023 / projects, datasette, weeknotes, datasettecloud, sqliteutils, shotscraper, openai

Migrating out of PostHaven. Amjith Ramanujam decided to migrate his blog content from PostHaven to a Markdown static site. He used shot-scraper (shelled out to from a Python script) to scrape his existing content using a snippet of JavaScript, wrote the content to a SQLite database using sqlite-utils, then used markdownify (new to me, a neat Python package for converting HTML to Markdown via BeautifulSoup) to write the content to disk as Markdown. # 24th May 2023, 7:38 pm

Types

Years

Tags