AnsweredAssumed Answered

reduce slow

Question asked by neweramapr on Oct 30, 2014
Latest reply on Nov 9, 2014 by nabeel
MapR 3.1.1 M5 trial license, one namenode 4 datanode(RAM 128GB,Disk 12x1T, CPU Xeon(R) CPU E5-2630 0 @ 2.30GHz 12x2 cores)

I ran a 500g terasort on my cluster, Map side is ok (7-8 minutes)but Reduce side is extremely slow(32 minutes), further breakdown, "copy & sort" phases are fine, but "reduce" phase is abnormal slow.

Please guide me how to tune the performance.

BTW, our benchmark on other Hadoop Distribution for same test is 12min 30 seconds, I want to see if MapR can run faster than that.

Thanks

Outcomes