Never finishes launching
yepher opened this issue · 2 comments
yepher commented
I have an HBase instance configured in h-rider that is not accessible on the network I am on. It appears when this happens h-rider will never get past the splash screen. It just sits spinning and says "Connecting to 192.168.200.138...".
Here is the information from the log:
2013-04-26 11:27:21.796 java[25978:11a03] Unable to load realm info from SCDynamicStore
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:host.name=192.168.200.131
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_43
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Apple Inc.
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.class.path=h-rider-1.0.5.0.jar
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/var/folders/9l/_q4mmgkj53x580kbw5ff_fdw0000gn/T/
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:os.name=Mac OS X
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:os.arch=x86_64
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:os.version=10.8.3
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:user.name=chris
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:user.home=/Users/chris
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:user.dir=/Users/chris/Software/hrider/target
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=180000 watcher=hconnection
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Opening socket connection to server /127.0.0.1:2181
13/04/26 11:27:22 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 25978@Chriss-MacBook-Air.local
13/04/26 11:27:22 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:27:22 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x13e4709ff1d001a, negotiated timeout = 40000
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=b2bimsrv01:2181 sessionTimeout=180000 watcher=hconnection
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Opening socket connection to server /10.200.2.107:2181
13/04/26 11:27:22 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 25978@Chriss-MacBook-Air.local
13/04/26 11:27:22 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:27:22 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Socket connection established to 10.200.2.107/10.200.2.107:2181, initiating session
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Session establishment complete on server 10.200.2.107/10.200.2.107:2181, sessionid = 0x13d7f723bb30447, negotiated timeout = 40000
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.200.138:2181 sessionTimeout=180000 watcher=hconnection
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Opening socket connection to server /192.168.200.138:2181
13/04/26 11:27:22 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 25978@Chriss-MacBook-Air.local
13/04/26 11:27:22 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:27:22 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:28:38 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Operation timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/04/26 11:28:38 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/04/26 11:28:38 INFO util.RetryCounter: Sleeping 2000ms before retry #1...
13/04/26 11:28:39 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.200.138/192.168.200.138:2181
13/04/26 11:28:39 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:28:39 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:29:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Operation timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/04/26 11:29:56 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/04/26 11:29:56 INFO util.RetryCounter: Sleeping 4000ms before retry #2...
13/04/26 11:29:57 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.200.138/192.168.200.138:2181
13/04/26 11:29:57 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:29:57 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:31:12 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Operation timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/04/26 11:31:12 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/04/26 11:31:12 INFO util.RetryCounter: Sleeping 8000ms before retry #3...
13/04/26 11:31:13 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.200.138/192.168.200.138:2181
13/04/26 11:31:13 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:31:13 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:32:29 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Operation timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/04/26 11:32:29 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/04/26 11:32:29 ERROR zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 3 retries
13/04/26 11:32:29 WARN zookeeper.ZKUtil: hconnection Unable to set watcher on znode /hbase/master
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:150)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:230)
at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.ensureZookeeperTrackers(HConnectionManager.java:591)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:633)
at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:109)
at hrider.hbase.Connection.<init>(Connection.java:87)
at hrider.hbase.ConnectionManager.create(ConnectionManager.java:23)
at hrider.config.ConnectionDetails.canConnect(ConnectionDetails.java:48)
at hrider.ui.forms.Window$4.run(Window.java:181)
at java.lang.Thread.run(Thread.java:680)
13/04/26 11:32:29 ERROR zookeeper.ZooKeeperWatcher: hconnection Received unexpected KeeperException, re-throwing exception
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:150)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:230)
at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.ensureZookeeperTrackers(HConnectionManager.java:591)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:633)
at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:109)
at hrider.hbase.Connection.<init>(Connection.java:87)
at hrider.hbase.ConnectionManager.create(ConnectionManager.java:23)
at hrider.config.ConnectionDetails.canConnect(ConnectionDetails.java:48)
at hrider.ui.forms.Window$4.run(Window.java:181)
at java.lang.Thread.run(Thread.java:680)
13/04/26 11:32:29 INFO client.HConnectionManager$HConnectionImplementation: This client just lost it's session with ZooKeeper, will automatically reconnect when needed.
13/04/26 11:32:30 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.200.138/192.168.200.138:2181
13/04/26 11:32:30 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:32:30 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
1
icher-g commented
The hbase client usually tries to reconnect a number of times before it gives up. I think the default is 10.
Maybe it is a good idea to decrease this number in hrider.
icher-g commented
The timeout has been introduced while connecting to the hbase.