AnsweredAssumed Answered

Impala statestore unable to send heartbeat

Question asked by asmith_195581 on Oct 14, 2016
Latest reply on Oct 18, 2016 by anilmapr

I have configured a mapr 5.1 cluster, with mapr tickets and kerberos enabled.  The impala services are starting normally and can be seen as "up" in the MCS.  However, I am getting the following errors in the statestored.INFO log:

 

I1014 14:16:50.408789 5728 thrift-server.cc:431] ThriftServer 'StatestoreService' started on port: 24000
I1014 14:17:18.531209 13959 statestore.cc:366] Creating new topic: ''catalog-update' on behalf of subscriber: 'impalad@server2:22000
I1014 14:17:18.531227 13959 statestore.cc:366] Creating new topic: ''impala-membership' on behalf of subscriber: 'impalad@server2:22000
I1014 14:17:18.531231 13959 statestore.cc:373] Registering: impalad@server2:22000
I1014 14:17:18.531524 13959 statestore.cc:396] Subscriber 'impalad@server2:22000' registered (registration id: da433eb9646e44d2:7aba6484bf666097)
I1014 14:17:18.542508 5882 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:18.542552 5882 statestore.cc:693] Unable to send topic update message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)
I1014 14:17:18.546381 5915 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:18.546423 5915 statestore.cc:693] Unable to send heartbeat message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)
I1014 14:17:19.558750 5915 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:19.558797 5915 statestore.cc:693] Unable to send heartbeat message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)
I1014 14:17:20.289906 5878 logging.cc:194] Old log file deleted during log rotation: /opt/mapr/impala/impala-2.5.0/logs/server3.mapr.log.INFO.20161013-143015.23048
I1014 14:17:20.290060 5878 logging.cc:194] Old log file deleted during log rotation: /opt/mapr/impala/impala-2.5.0/logs/server3.mapr.log.WARNING.20161013-143015.23048
I1014 14:17:20.290189 5878 logging.cc:194] Old log file deleted during log rotation: /opt/mapr/impala/impala-2.5.0/logs/server3.mapr.log.ERROR.20161013-143015.23048
I1014 14:17:20.550853 5882 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:20.550902 5882 statestore.cc:693] Unable to send topic update message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)
I1014 14:17:20.568914 5915 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:20.568956 5915 statestore.cc:693] Unable to send heartbeat message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)
I1014 14:17:21.578038 5915 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:21.578093 5915 statestore.cc:693] Unable to send heartbeat message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)
I1014 14:17:22.557997 5882 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:22.558058 5882 statestore.cc:693] Unable to send topic update message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)
I1014 14:17:22.583798 5915 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:22.583844 5915 statestore.cc:693] Unable to send heartbeat message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)
I1014 14:17:23.593258 5915 thrift-client.cc:55] Unable to connect to server2:23000
I1014 14:17:23.593317 5915 statestore.cc:693] Unable to send heartbeat message to subscriber impalad@server2:22000, received error: Couldn't open transport for server2:23000 (No more data to read.)

 

Thanks for any assistance,

 

Aaron

Outcomes