AnsweredAssumed Answered

Bulkload to M7 hbase using mapreduce throwing class not found exception

Question asked by ramyakalimuthu on Jul 1, 2015
Hi
I am using mapreduce code to bulkload my file to hbase, I am getting class not found exception.
Below is the error stack

    java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.io.compress.Lz4Codec
            at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$5.buildCodec(Compression.java:237)
            at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$5.getCodec(Compression.java:222)
            at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getCompressor(Compression.java:303)
            at org.apache.hadoop.hbase.io.hfile.HFileBlock$Writer.<init>(HFileBlock.java:745)
            at org.apache.hadoop.hbase.io.hfile.HFileWriterV2.finishInit(HFileWriterV2.java:135)
            at org.apache.hadoop.hbase.io.hfile.HFileWriterV2.<init>(HFileWriterV2.java:126)
            at org.apache.hadoop.hbase.io.hfile.HFileWriterV2$WriterFactoryV2.createWriter(HFileWriterV2.java:105)
            at org.apache.hadoop.hbase.io.hfile.HFile$WriterFactory.create(HFile.java:400)
            at org.apache.hadoop.hbase.regionserver.StoreFile$Writer.<init>(StoreFile.java:1051)
            at org.apache.hadoop.hbase.regionserver.StoreFile$Writer.<init>(StoreFile.java:995)
            at org.apache.hadoop.hbase.regionserver.StoreFile$WriterBuilder.build(StoreFile.java:870)
            at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat$1.getNewWriter(HFileOutputFormat.java:206)
            at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat$1.write(HFileOutputFormat.java:163)
            at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat$1.write(HFileOutputFormat.java:124)
            at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:544)
            at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
            at org.apache.hadoop.hbase.mapreduce.PutSortReducer.reduce(PutSortReducer.java:72)
            at org.apache.hadoop.hbase.mapreduce.PutSortReducer.reduce(PutSortReducer.java:40)
            at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
            at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:602)
            at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:444)
            at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
            at java.security.AccessController.doPrivileged(Native Method)
            at javax.security.auth.Subject.doAs(Subject.java:415)
            at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
            at org.apache.hadoop.mapred.Child.main(Child.java:264)
Please help to resolve this error

thanks
Ramya

Outcomes