AnsweredAssumed Answered

Intermitten Could Not Create FileClient com.mapr.fs.MapRFileSystem.lookupClient(MapRFileSystem.java:458)

Question asked by coderfi on Feb 26, 2015
Latest reply on May 3, 2016 by quantumfi
I am getting this error intermittently on MapRBuildVersion 3.1.1.26113.GA

Could someone with access to the source code take a look at what is happening at `MapRFileSystem.java:458` ?

I suspect is has to do with too many connected clients.

thanks,
Fi

    java.io.IOException: Could not create FileClient
     at com.mapr.fs.MapRFileSystem.lookupClient(MapRFileSystem.java:458)
     at com.mapr.fs.MapRFileSystem.lookupClient(MapRFileSystem.java:519)
     at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:662)
     at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:485)
     at org.apache.hadoop.mapred.LineRecordReader.<init>(LineRecordReader.java:102)
     at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:58)
     at org.apache.spark.rdd.HadoopRDD$$anon$1.<init>(HadoopRDD.scala:236)
     at org.apache.spark.rdd.HadoopRDD.compute(HadoopRDD.scala:212)
     at org.apache.spark.rdd.HadoopRDD.compute(HadoopRDD.scala:101)
     at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
     at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
     at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
     at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
     at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
     at org.apache.spark.api.python.PythonRDD$WriterThread$$anonfun$run$1.apply$mcV$sp(PythonRDD.scala:244)
     at org.apache.spark.api.python.PythonRDD$WriterThread$$anonfun$run$1.apply(PythonRDD.scala:206)
     at org.apache.spark.api.python.PythonRDD$WriterThread$$anonfun$run$1.apply(PythonRDD.scala:206)
     at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1618)
     at org.apache.spark.api.python.PythonRDD$WriterThread.run(PythonRDD.scala:205)

Outcomes