AnsweredAssumed Answered

10Ge and lots of drives

Question asked by mapr_user62 on Jul 4, 2013
Latest reply on Jul 4, 2013 by mapr_user62
How much data can I expect to push with 48drives (jbod) and 10Ge on a datanode.

I can achieve upto 2GB/sec in reads by doing dd's to the drives(raw device). When I use MaprFs to read files through NFS, I see only 0.6GB/sec in reads.

I tried using 10,20 or even 30 concurrent dd's to do this. The files I am trying to read are all on the same node with all the chunks on the same node, so I am not using the network at all. Nfs is mounted on localhost. I also noticed that mfs and nfserver process consume about 90% of cpu. I have 24 cores on the server with 64gb of RAM.

Is this expected?  Should I be able to get more from a single node? Are there any tunables I can try?

Thanks.

Outcomes