AnsweredAssumed Answered

Troubleshoot NFS Performance

Question asked by mandoskippy on Aug 21, 2014
I am copying a file from location in MapRFS to another in MapRFS but using NFS To do so. This is a large file, 4 GB.  When I am copying this file, the performance of NFS shares becomes nothing.  But in general my performance is not good on my FS.  I have a 4GB file, I go to delete it using hadoop fs -rm /path/to/file.txt and it takes forever, in excess of 60 seconds and the gives me an RPC timeout error.  That just doesn't seem right to me.  How can I troubleshoot this type of performance? This seems out of whack I am on 3.1.0.  NFS hangs often, mfs seems slow, how can I troubleshoot? Where I can look?

Thanks

Error when I tried to hadoop fs -rm
Timing out request 28.13 sent to 192.168.18.103:5660
Other ips are: 192.168.18.103:5660 192.168.16.103:5660 192.168.19.103:5660 192.168.17.103:5660
2014-08-21 16:54:17,9073 ERROR Client fs/client/fileclient/cc/client.cc:4218 Thread: 140061636507392 rpc err Connection timed out(110) 28.13 to 192.168.16.103:5660, fid 3010.2663734.17707926, upd 1

Note, I tested each interface ( I have hour 1 GBPS links between nodes, each interface has it's own subnet and switch independent from the others) All of the IPs ping properly, with lo latency.


Outcomes