Simon Willison’s Weblog

Subscribe

Monday, 2nd November 2020

selenium-wire. Really useful scraping tool: enhances the Python Selenium bindings to run against a proxy which then allows Python scraping code to look at captured requests—great for if a site you are working with triggers Ajax requests and you want to extract data from the raw JSON that came back.

# 6:58 pm / scraping, data-journalism, python, selenium

2020 » November

MTWTFSS
      1
2345678
9101112131415
16171819202122
23242526272829
30