| 2009/07/27 Decline of the Enterprise Data Warehosue Due to Hadoop, HBase, and Hive
With the rise of Social Media and the decreasing cost of storage, very small companies have a need for processing massive quantities of data. Furthermore, it's easier than ever to write software to generate/output/process data, thanks to languages like Ruby, frameworks like Spring, and scalability best practices. A few days' work and a handful of engineers can net you a bare-bones Twitter clone, or a crawler to get the link graph of the entire Internet. This data growth can be far from linear. You simply can't analyze this much data in an RDBMS - but these small startups can't spend millions on DWs, either. Since the analysis is a core of the business, internal hacked-together tools cobbled together from SQL boxes often emerged. What results is a temporary solution, not a platform. With Hadoop, HBase, and Hive, there’s now a free, scalable Data Warehousing platform that makes it possible to migrate a considerable portion of DW analytics....
|