AnsweredAssumed Answered

hadoop fs -ls is laggy

Question asked by jerdavis2 on Feb 2, 2015
Latest reply on Feb 3, 2015 by jerdavis2
Hi, I'm getting really bad hadoop fs performance and I'm wondering how I would go about debugging/fixing this issue?
The cluster is nearly idle, Lots of CPU, Network,Memory available.
I changed the MFS/LRU cache on the CLDB to 100GB: inode:6:log:6:meta:10:dir:40:small:15
And all other nodes to be 20GB:inode:6:log:6:meta:10:dir:6:small:27

So I think there are plenty of resources...

I noticed it also had an ERROR:

    [me@foo-user01 ~]$ hadoop fs -ls /somedir/foo
    2015-02-02 14:46:33,3156 ERROR Client fs/client/fileclient/cc/client.cc:4218 Thread: 140613949572864 rpc err Connection timed out(110) 28.9 to 10.100.0.104:5660, fid 2335.2241355.229659410, upd 0
    Found 1377 items
    ..etc..


Outcomes