AnsweredAssumed Answered

hadoop map/reduce job data ingestion

Question asked by iarch on Apr 11, 2012
Latest reply on Apr 11, 2012 by srivas
I have seen hadoop map/reduce job to process huge amount data which it is in the hadoop system already (HDFS/HBase etc). Most likely it is offline processing.

However, I wonder if there is any system for large data ingestion using hadoop map/reduce capabilities for near real time data feeds. Of course, the data feeds will most likely be outside of hadoop system. For example, a live email server or a web log etc.