Simon Willison’s Weblog

Subscribe

Items tagged crawling in Feb, 2018

Filters: Year: 2018 × Month: Feb × crawling × Sorted by date


Googlebot’s Javascript random() function is deterministic. random() as executed by Googlebot returns the same predicable sequence. More interestingly, Googlebot runs a much faster timer for setTimeout and setInterval—as Tom Anthony points out, “Why actually wait 5 seconds when you are a bot?” # 7th February 2018, 2:41 am

Types

Years

Months

Tags