AnsweredAssumed Answered

Merge multiple gz files without using local system.

Question asked by vb_217 on Jun 25, 2015
Latest reply on Oct 21, 2015 by rhinomike
Hello,
I have multiple small gz files that I want to merge using hadoop commands.How can I do this?
Ex. I have two files  /path/0.gz and  /path/1.gz in folder /path/. I want to merge these two files into folder /path/merge/foo.gz

I have used -getmerge but that merges to a file on local system.
I have tried hadoop fs -cat /path/*.gz > /path/merge_folder/foo.gz

Thanks in advance
VB

Outcomes