AnsweredAssumed Answered

Data corruption. Any additional logging for hadoop commands?

Question asked by mrbalky on May 18, 2012
Latest reply on May 18, 2012 by mrbalky
I have encountered a problem with the hadoop -put command corrupting data when it lands on my MapR cluster.  There are no error messages, and the command exits with a 0 exit code.  The file being uploaded is an LZOP compressed file with .lzo extension.  Our cluster is configured such that .lzo files  are not recompressed by the native compression of the MapR system.

Since this is a silent failure (among many successful puts), is there a way to enable additional logging or diagnostics for the hadoop command?  Are there MapR logs that the cluster generates that might give me a clue as to what's going on?

Thanks

Outcomes