Wednesday, February 15, 2012

How I met Hadoop

This blog briefs my personal experience with Hadoop.

Having had to work on it,I did some research and predict it will undergo wide adoption.Various resources led me to this.Some of them are:

1.IT research firms like Gartner.
2.Computer sites like InfoWorld, GigaOm etc.,
3.Its is used in some form or other by Google,Facebook,Yahoo etc.,
4.Slew of start-ups betting on Hadoop(Cloudera,Karmasphere,Mapr,Pentaho etc.,).

Other tech stuff that caught my attention but didn't choose to get involved in them for various reasons-
1.Scala - Possible Java successor(?)
2.OpenStack - this can become android of the clouds.
3.SAP Hana - In memory database
4.HTML5 - Solves the problem of writing native mobile/computer apps among many other benefits

After extensive Google mining(I think I can coin a new buzz word :) ) , I predict that Hadoop skills will be in high demand in the coming years.Having a full time job, I am risking by spending time on a technology that has not yet been adopted widely.Hope it turns out to be worthy.

I could not find any Hadoop training available in India(excluding internal training by companies using Hadoop already in their projects).Currently there are sites like Cloudera offering training but that is too costly and not sure if its worth the money.IBM has big data university website that offers free Hadoop training.Yet to try it and seems they are trying to lock you to IBM products with their free training.

Hope this blog helps people who are in the same boat as me.I will post how I ran my first Hadoop job in coming post.