Simon Willison’s Weblog

Subscribe

NoSQL: What is the “best” solution for storing high volumes of structured data?

1st November 2013

My answer to NoSQL: What is the “best” solution for storing high volumes of structured data? on Quora

On the right setup, PostgreSQL can handle petabytes. There are also commercial vendors such as Greenplum that offer data warehouse solutions built on a modified version of PostgreSQL.

You should also take a look at Hadoop and Hive. Hive lets you use a language based heavily on SQL to construct map reduce queries which can then run against a Hadoop cluster.

Posted 1st November 2013 at 6:45 pm · Follow me on Mastodon, Bluesky, Twitter or subscribe to my newsletter

More recent articles

This is NoSQL: What is the “best” solution for storing high volumes of structured data? by Simon Willison, posted on 1st November 2013.

Next: Why do so many London based SAAS startups only price in dollars?

Previous: Is it better to create your own framework, or would it be best to just use Django or something like that?

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe