AnsweredAssumed Answered

what's the RPC listening port of MapR?

Question asked by sghan on Dec 30, 2013
Latest reply on Jan 5, 2014 by sghan
I'm trying to access the MapR file system with RPC, but failed. I had tried port of 5660(mfs.port), 7222(cldb.port), etc, am I trying the right port?

The details:

1 Below service is installed and started:
  cldb fileserver jobtracker nfs tasktracker webserver zookeeper
  
2 The basic MapReduce task (e.g. wordcount) is OK.

3 Write some codes with RPC to access the hadoop hdfs with below configuration in core-site.xml (from hadoop), the result is OK.
                <name>fs.default.name</name>
                <value>hdfs://host101:9000/</value>
                
4 With same codes by changing 9000 to 5660 or 7222 to access MapR file system, an exception will be thrown as below:

[admin@host101 logs]$ mrsh jar /opt/mapreduce/hadoop-0.20.2-examples.jar wordcount /user/root/input /user/root/output
You are using Hadoop API with 0.20.2 version.
java.io.IOException: Call to host101/9.111.158.195:5660 failed on local exception: java.io.IOException: Connection reset by peer
        at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
        at org.apache.hadoop.ipc.Client.call(Client.java:743)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
        at $Proxy0.getProtocolVersion(Unknown Source)
        at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
        at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1490)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:70)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1502)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:280)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:99)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(FileInputFormat.java:357)
        at org.apache.hadoop.examples.WordCount.main(WordCount.java:65)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
        at java.lang.reflect.Method.invoke(Method.java:611)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
        at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
        at java.lang.reflect.Method.invoke(Method.java:611)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcher.read0(Native Method)
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:33)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:210)
        at sun.nio.ch.IOUtil.read(IOUtil.java:183)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:255)
        at org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:55)
        at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
        at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:155)
        at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:128)
        at java.io.FilterInputStream.read(FilterInputStream.java:127)
        at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:276)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:229)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:248)
        at java.io.DataInputStream.readInt(DataInputStream.java:381)
        at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
        at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)

Outcomes