Apache Hadoop turns 10

The Apache Hadoop has turned 10. Popularly called the poster child of big data, it was primarily inspired by open source implementation of Google's papers on their File System (GFS) and execution engine (MapReduce).

Originally a part of an older open source project, Apache Nutch, the technology came on its own in 2006. Hadoop founder Doug Cutting, formerly with Yahoo, and presently chief architect at Cloudera, wrote a blog post commemorating the birthday of the project, "Hadoop has come to symbolize big data, itself central to this century's industrial revolution: the digital transformation of business. Ten years ago, digital business was limited to a few sectors, like e-commerce and media. Since then, we have seen digital technology become essential to nearly every industry. Every industry is becoming data driven, built around its information systems. Big data tools like Hadoop enable industries to best benefit from all the data they generate."

He goes on to add, "Hadoop was then a game changer. Developers could much more quickly and easily build better methods of advertising, spell-checking, page layout, and so on. Increasingly, users outside of Yahoo! started to deploy Hadoop, at companies like Facebook, Twitter, and LinkedIn. Other projects were soon built on top of Hadoop, like Apache Pig, Apache Hive, Apache HBase, and so on. Academic researchers began to use Hadoop. We had reached the target I had initially imagined: a popular open source project that enabled easy, affordable storage and analysis of bulk data."

According to a recent report by Forrester Research's big data analysts, adopting Hadoop is "mandatory" for any organization that wishes to do advanced analytics and get actionable insights on their data.

In the Forrester Wave for Big Data Hadoop Distributions, analysts claim that application developer and delivery professionals are adopting Hadoop "en masse" and they forecast that 100% of large enterprises will eventually adopt Hadoop.

The report also put Cloudera, Hortonworks, IBM, and MapR Technologies in the leader's sector.

Comments