Wednesday, September 1, 2010

Hive and the SQL-Like fashion

Hive is a nice SQL like interface on the top of Hadoop, an open source platform realized by Doug Coutting. More and more the database is used for non online transactions.

Fulcrum was the first time I saw a SQL-like interface for retrieval back in 1996, now it's funny to see the Map/Reduce paradigm expressed in SQL-like as in

  FROM (
FROM pv_users
MAP pv_users.userid,
USING 'map_script'
AS dt, uid
CLUSTER BY dt) map_output

REDUCE map_output.dt, map_output.uid
USING 'reduce_script'
AS date, count;

No comments:

Post a Comment