AnsweredAssumed Answered

Docker Cluster ERROR iodispatch.cc:116 io-setup failed, -11

Question asked by vad1s0n on Feb 9, 2016
Latest reply on May 2, 2016 by bpark

Hello, we're trying to set up cluster on Docker. We run 4 nodes on 1 host machine, 3 of them work fine. But 4th causes error, when I perform  */opt/mapr/server/configure.sh ...* command:

 

Error 3, No such process. Unable to reach mfs. Check for errors in mfs.log.

 


***Mfs.log:  ***

******* Starting mfs server ******* 
*** mfs mapr-version: $Id: mapr-version: 5.0.0.32987.GA 32987:91644ddfd0ba $ *** 

2016-02-09 18:38:22,9146 INFO mapfs.cc:1339 FS : Using hostname f77e60ad5dfc, port: 5660, hostid 0x14d46709eb0c9bff (1500937868117056511) 

2016-02-09 18:38:22,9146 INFO mapfs.cc:1341 Starting fileserver on : 

2016-02-09 18:38:22,9146 INFO mapfs.cc:1344 10.0.1.5:5660 

2016-02-09 18:38:22,9146 INFO mapfs.cc:1346 HighLatencyTraceThresh : 3000 ms  
2016-02-09 18:38:22,9158 INFO cachemgr.cc:3066 cachePercentagesIn: inode:3:meta:6:dir:6:small:27  
2016-02-09 18:38:22,9158 INFO cachemgr.cc:3081 CacheSize 2212 MB,   inode:3:meta:6:dir:6:small:27:large:58:db:0:valc:0  
2016-02-09 18:38:22,9300 INFO cachemgr.cc:2888 lru meta (0), start 1, end 16478, blocks 16478 [ 128M], dirtyquota 6591 [ 51M]  
2016-02-09 18:38:22,9302 INFO cachemgr.cc:2888 lru dir (3), start 16479, end 32956, blocks 16478 [  128M], dirtyquota 6591 [ 51M]  
2016-02-09 18:38:22,9314 INFO cachemgr.cc:2888 lru small (1), start 32957, end 107109, blocks 74153 [ 579M], dirtyquota 66737 [ 521M]  
2016-02-09 18:38:22,9338 INFO cachemgr.cc:2888 lru large (2), start 107110, end 274641, blocks 167532 [1308M], dirtyquota 66737 [ 521M]  
2016-02-09 18:38:22,9500 INFO cachemgr.cc:2931 lru inode (5), start 1, end 271808, inodes 271808 [ 66M], dirtyquota 108723 [ 26M]  
2016-02-09 18:38:22,9619 INFO cachemgr.cc:2972 lru cluster (6), start 1, end 241685, cluster 241685 [ 22M]  
2016-02-09 18:38:22,9619 INFO cachemgr.cc:3129 Total dcache: 274641, icache 271808, ccache 241685. memUsed 2432463790  
2016-02-09 18:38:22,9622 INFO cachemgr.cc:3500 CM: Wrote cache offsets in /opt/mapr/server/data/mfs-cache.dat  
2016-02-09 18:38:23,4592 INFO mapfs.cc:233 mfs using maxTotalRpcs 1029  
2016-02-09 18:38:23,4592 INFO mapfs.cc:234 clientRpcTimeout 60000 ms  
2016-02-09 18:38:23,4593 INFO iodispatch.cc:97 using IO maxEvents: 16384  
2016-02-09 18:38:23,4596 ERROR iodispatch.cc:116 io-setup failed, -11


We have enough memory on host machine (38gb free of 64gb). If I stop one of 3 working node, the 4th starts without this error. Could you please give us advice for this error ERROR iodispatch.cc:116 io-setup failed, -11 or for the situation in general.

Outcomes