AnsweredAssumed Answered

MapR and snappy compression

Question asked by epalace on Mar 20, 2012
Latest reply on Mar 22, 2012 by amit
I tried to install snappy compression with MapR following the steps in :

http://code.google.com/p/hadoop-snappy/
previously installing the native library from :
http://code.google.com/p/snappy/

and Jobtracker and tasktrackers manage to detect it and load it , but when they try to use it in a sequence file then fails abruptely :

2012-03-21 10:40:43,404 FATAL org.apache.hadoop.mapred.Child: Error running child : java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.compress.snappy.SnappyCompressor.compressBytesDirect()I at org.apache.hadoop.io.compress.snappy.SnappyCompressor.compressBytesDirect(Native Method) at org.apache.hadoop.io.compress.snappy.SnappyCompressor.compress(SnappyCompressor.java:229) at

It seems a problem concerning native library loading.Is anyone facing this problem about hadoop-snappy native library ?

I tried to patch hadoop-snappy with this : http://code.google.com/p/hadoop-snappy/issues/detail?id=6
but doesn't compile (RTL_DEFAULT symbol missing).

Thanks

Outcomes