AnsweredAssumed Answered

M3: /api/job/table timed out

Question asked by mapr123 on Jul 5, 2013
Latest reply on Jul 12, 2013 by yufeldman
I keep getting this error and not sure what it is the cause. I followed install as documentation shows. I have no iptables running. I am using the sample 5 node diagram as in the documentation..


Thanks
bg

The request to /api/job/table timed out. Refresh and try again. If this persists, please check your computer's network connection. For further debug info, view /opt/mapr/logs/adminuiapp.log on the host.




Last packet sent to the server was 0 ms ago.
        at com.mysql.jdbc.Connection.createNewIO(Connection.java:2847)
        at com.mysql.jdbc.Connection.<init>(Connection.java:1555)
        at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:285)
        at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:134)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:182)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:171)
        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137)
        at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014)
        at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32)
        at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810)
        at com.mchange.v2.async.ThreadPerTaskAsynchronousRunner$TaskThread.run(ThreadPerTaskAsynchronousRunner.java:255)
2013-07-05 13:54:13,415 WARN  com.mchange.v2.resourcepool.BasicResourcePool [Task-Thread-for-com.mchange.v2.async.ThreadPerTaskAsynchronousRunner@762d4c7e]: com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask@5e6bbb36 -- Acquisition Attempt Failed!!! Clearing pending acquires. While trying to acquire a needed new resource, we failed to succeed more than the maximum number of allowed acquisition attempts (30). Last acquisition attempt exception:
com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception:

** BEGIN NESTED EXCEPTION **

java.net.ConnectException
MESSAGE: Connection refused

STACKTRACE:

java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
        at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at java.net.Socket.connect(Socket.java:478)
        at java.net.Socket.<init>(Socket.java:375)
        at java.net.Socket.<init>(Socket.java:218)
        at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:256)
        at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:271)
        at com.mysql.jdbc.Connection.createNewIO(Connection.java:2771)
        at com.mysql.jdbc.Connection.<init>(Connection.java:1555)
        at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:285)
        at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:134)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:182)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:171)
        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137)
        at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014)
        at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32)
        at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810)
        at com.mchange.v2.async.ThreadPerTaskAsynchronousRunner$TaskThread.run(ThreadPerTaskAsynchronousRunner.java:255)


** END NESTED EXCEPTION **



Last packet sent to the server was 1 ms ago.
        at com.mysql.jdbc.Connection.createNewIO(Connection.java:2847)
        at com.mysql.jdbc.Connection.<init>(Connection.java:1555)
        at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:285)
        at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:134)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:182)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:171)
        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137)
        at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014)
        at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32)
        at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810)
        at com.mchange.v2.async.ThreadPerTaskAsynchronousRunner$TaskThread.run(ThreadPerTaskAsynchronousRunner.java:255)
2013-07-05 13:54:13,417 WARN  com.mchange.v2.resourcepool.BasicResourcePool [Task-Thread-for-com.mchange.v2.async.ThreadPerTaskAsynchronousRunner@762d4c7e]: com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask@3549494e -- Acquisition Attempt Failed!!! Clearing pending acquires. While trying to acquire a needed new resource, we failed to succeed more than the maximum number of allowed acquisition attempts (30). Last acquisition attempt exception:
com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception:

** BEGIN NESTED EXCEPTION **

java.net.ConnectException
MESSAGE: Connection refused

STACKTRACE:

java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
        at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at java.net.Socket.connect(Socket.java:478)
        at java.net.Socket.<init>(Socket.java:375)
        at java.net.Socket.<init>(Socket.java:218)
        at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:256)
        at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:271)
        at com.mysql.jdbc.Connection.createNewIO(Connection.java:2771)
        at com.mysql.jdbc.Connection.<init>(Connection.java:1555)
        at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:285)
        at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:134)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:182)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:171)
        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137)
        at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014)
        at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32)
        at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810)
        at com.mchange.v2.async.ThreadPerTaskAsynchronousRunner$TaskThread.run(ThreadPerTaskAsynchronousRunner.java:255)


** END NESTED EXCEPTION **



Last packet sent to the server was 0 ms ago.
        at com.mysql.jdbc.Connection.createNewIO(Connection.java:2847)
        at com.mysql.jdbc.Connection.<init>(Connection.java:1555)
        at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:285)
        at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:134)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:182)
        at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:171)
        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137)
        at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014)
        at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32)
        at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810)
        at com.mchange.v2.async.ThreadPerTaskAsynchronousRunner$TaskThread.run(ThreadPerTaskAsynchronousRunner.java:255)
2013-07-05 13:54:54,616 INFO  com.mapr.adminuiapp.common.HibernateUtil [Timer-2]: fileChanged
2013-07-05 13:54:54,619 INFO  org.hibernate.cfg.Configuration [Timer-2]: configuring from resource: /hibernate.cfg.xml
2013-07-05 13:54:54,620 INFO  org.hibernate.cfg.Configuration [Timer-2]: Configuration resource: /hibernate.cfg.xml
2013-07-05 13:54:54,629 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/Job.hbm.xml
2013-07-05 13:54:54,648 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/JobAttributes.hbm.xml
2013-07-05 13:54:54,663 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/JobEvent.hbm.xml
2013-07-05 13:54:54,680 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/JobTransaction.hbm.xml
2013-07-05 13:54:54,696 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/Task.hbm.xml
2013-07-05 13:54:54,713 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/TaskAttempt.hbm.xml
2013-07-05 13:54:54,731 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/TaskEvent.hbm.xml
2013-07-05 13:54:54,826 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/TaskAttemptEvent.hbm.xml
2013-07-05 13:54:54,846 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/TaskAttemptTransaction.hbm.xml
2013-07-05 13:54:54,865 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/TaskAttemptAttributes.hbm.xml
2013-07-05 13:54:54,879 INFO  org.hibernate.cfg.Configuration [Timer-2]: Reading mappings from resource : com/mapr/adminuiapp/jobmanagement/domain/JobHistoryTracker.hbm.xml
2013-07-05 13:54:54,892 INFO  org.hibernate.cfg.Configuration [Timer-2]: Configured SessionFactory: null
2013-07-05 13:54:54,893 INFO  com.mapr.adminuiapp.common.HibernateUtil [Timer-2]: New DBUrl: jdbc:mysql://localhost:3306/metrics, New dbUser: mapr, New dbPassw: ****, New jdbc batch size: 25
[root@gruetli ~]#

Outcomes