Simon Willison’s Weblog


12 items tagged “yql”


A predictable web of data—the why of YQL. Christian Heilmann is moving from Yahoo! to Mozilla to head up their evangelism team, and has marked the occasion by releasing the first chapter of a proposed book on YQL.

# 30th October 2010, 7:44 am / christian-heilmann, mozilla, yahoo, yql, recovered, evangelism

Yahoo! Developer Network: Important API Updates and Changes. Some important (and potentially worrying) news about Yahoo! APIs. The BOSS (Build your Own Search Service) API will no longer be free—not an enormous surprise, and hopefully the pricing will be sensible. Most of the other search APIs (including web, news and image search) are being turned off with no replacement, while term extraction and spelling suggestions will be YQL-only. Most worrying, changes to Geo, Maps and Local APIs will be announced in September, with some set to close. I really hope this doesn’t affect the GeoPlanet APIs.

# 17th August 2010, 6:14 pm / apis, boss, geoplanet, yahoo, yql, recovered

GeoPlanet Explorer. Chris Heilmann’s YQL powered explorer for the invaluable Yahoo! GeoPlanet / WhereOnEarth dataset. Every API deserves an explorer of some sort.

# 2nd March 2010, 8:14 am / apis, christian-heilmann, geoplanet, yahoo, yql


Today’s News and Yahoo!’s Developer Program. “For SearchMonkey and BOSS, we currently do not have anything concrete to tell you” ... “We wanted to let you know that today’s news does not affect these products [YUI, YQL, Pipes]”.

# 30th July 2009, 12:20 pm / boss, pipes, searchmonkey, yahoo, yahoopipes, ydn, yql, yui

YQL: INSERT INTO internet. insert into twitter.status (status,username,password) values (“Playing with INSERT, UPDATE and DELETE in YQL”, “twitterusername”,“twitterpassword”)

# 8th July 2009, 8:19 pm / apis, sql, twitter, yahoo, yql

JS-Placemaker—geolocate texts in JavaScript. Chris Heilmann exposed Placemaker to JavaScript (JSONP) using a YQL execute table. Try his examples—I’m impressed that “My name is Jack London, I live in Ontario” returns just Ontario, demonstrating that Placemaker’s NLP is pretty well tuned.

# 23rd May 2009, 12:36 am / christian-heilmann, geocoding, geospatial, javascript, jsonp, nlp, placemaker, yahoo, yql, yqlexecute

With YQL Execute, the Internet becomes your database. This is nuts (in a good way). Yahoo!’s intriguing universal SQL-style XML/JSONP web service interface now supports JavaScript as a kind of stored procedure language, meaning you can use JavaScript and E4X to screen-scrape web pages, then query the results with YQL.

# 29th April 2009, 10:50 pm / apis, e4x, javascript, json, jsonp, sql, xml, yahoo, yql

Yahoo! Query Language thoughts. An engineer on Google’s App Engine provides an expert review of Yahoo!’s YQL. I found this more useful than the official documentation.

# 9th February 2009, 10:29 pm / appengine, google, yahoo, yql

YQL opens up 3rd-party web service table definitions to developers. This really is astonishingly clever: you can create an XML file telling Yahoo!’s YQL service how to map an arbitrary API to YQL tables, then make SQL-style queries against it (including joins against other APIs). Another neat trick: doing a SQL “in” query causes API requests to be run in parallel and recombined before being returned to you.

# 9th February 2009, 9:08 pm / apis, sql, yahoo, yql


Amazon SimpleDB—Now With Select. So now all three of Yahoo!, Amazon and Google have invented their own SQL-like languages (YQL, SimpleDB and GQL)—though it looks like Yahoo!’s is the only one that attempts to provide joins.

# 18th December 2008, 8:59 am / amazon, google, gql, simpledb, sql, sqllike, yahoo, yql

Yahoo! Query Language Console. Neat developer tool for playing around with YQL.

# 13th December 2008, 9:39 am / console, yahoo, yql

YQL—converting the web to JSON with mock SQL. YQL just got a whole lot more interesting to me—I had no idea they were exposing an HTML and RSS scraping tool over a JSONP API in addition to all of the Yahoo! web service methods.

# 13th December 2008, 9:39 am / html, json, jsonp, scraping, screenscraping, sql, yahoo, yql