Skip to main content

deadlock in Glassfish 3.1

5 replies [Last post]
okna2000
Offline
Joined: 2009-07-19
Points: 0

Hi,
I am using glassfish3.1 GA build with felix. If I remove temporary files (from generated and osgi-cache folders) and start a server, I get a deadlock (the log is attached below). Here is the list of bundles in glassfish\modules\autostart:
org.apache.felix.bundlerepository.jar
org.apache.felix.eventadmin.jar
org.apache.felix.fileinstall-autodeploy-bundles.cfg
org.apache.felix.scr.jar
org.apache.felix.webconsole.internal.servlet.OsgiManager.cfg
osgi-cdi.jar
osgi-ee-resources.jar
osgi-ejb-container.jar
osgi-javaee-base.jar
osgi-jdbc.jar
osgi-jpa.jar
osgi-jta.jar
osgi-web-container.jar
Is it a known bug?
The thread dump with deadlock:

2011-05-03 12:06:45
Full thread dump Java HotSpot(TM) Client VM (11.3-b02 mixed mode):

"pool-10-thread-1" daemon prio=6 tid=0x30c6a400 nid=0x17c waiting for monitor entry [0x31bef000..0x31befb14]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.util.logging.StreamHandler.publish(StreamHandler.java:174)
- waiting to lock <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:88)
at java.util.logging.Logger.log(Logger.java:458)
at com.sun.logging.LogDomains$1.log(LogDomains.java:354)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.log(Logger.java:503)
at com.sun.enterprise.server.logging.LogManagerService$1.deleted(LogManagerService.java:368)
at org.glassfish.kernel.FileMonitoringImpl$2.run(FileMonitoringImpl.java:113)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x03b5e470> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"telnetconsole.shell remote=/127.0.0.1:3964" prio=6 tid=0x30711400 nid=0x2bc runnable [0x2fecf000..0x2fecfb94]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at org.apache.felix.gogo.shell.Console.getLine(Console.java:117)
at org.apache.felix.gogo.shell.Console.run(Console.java:53)
at org.apache.felix.gogo.shell.Shell.console(Shell.java:203)
at org.apache.felix.gogo.shell.Shell.gosh(Shell.java:128)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.felix.gogo.runtime.Reflective.method(Reflective.java:136)
at org.apache.felix.gogo.runtime.CommandProxy.execute(CommandProxy.java:82)
at org.apache.felix.gogo.runtime.Closure.executeCmd(Closure.java:469)
at org.apache.felix.gogo.runtime.Closure.executeStatement(Closure.java:395)
at org.apache.felix.gogo.runtime.Pipe.run(Pipe.java:108)
at org.apache.felix.gogo.runtime.Closure.execute(Closure.java:183)
at org.apache.felix.gogo.runtime.Closure.execute(Closure.java:120)
at org.apache.felix.gogo.runtime.CommandSessionImpl.execute(CommandSessionImpl.java:89)
at org.apache.felix.shell.remote.Shell.startGogoShell(Shell.java:108)
at org.apache.felix.shell.remote.Shell.run(Shell.java:81)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"dol-jar-scanner" daemon prio=6 tid=0x30c6ec00 nid=0x12e0 waiting for monitor entry [0x3236f000..0x3236fc14]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.util.logging.StreamHandler.flush(StreamHandler.java:223)
- waiting to lock <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:89)
at java.util.logging.Logger.log(Logger.java:458)
at com.sun.logging.LogDomains$1.log(LogDomains.java:354)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.log(Logger.java:503)
at org.glassfish.hk2.classmodel.reflect.Parser$3.call(Parser.java:302)
at org.glassfish.hk2.classmodel.reflect.Parser$3.call(Parser.java:294)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x03b5f7b8> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"dol-jar-scanner" daemon prio=6 tid=0x30c21400 nid=0x1b08 waiting for monitor entry [0x3231f000..0x3231fc94]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.util.logging.StreamHandler.publish(StreamHandler.java:174)
- waiting to lock <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:88)
at java.util.logging.Logger.log(Logger.java:458)
at com.sun.logging.LogDomains$1.log(LogDomains.java:354)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.log(Logger.java:503)
at java.util.logging.Logger.fine(Logger.java:1054)
at org.glassfish.hk2.classmodel.reflect.Parser.doJob(Parser.java:338)
at org.glassfish.hk2.classmodel.reflect.Parser.access$300(Parser.java:70)
at org.glassfish.hk2.classmodel.reflect.Parser$3.call(Parser.java:305)
at org.glassfish.hk2.classmodel.reflect.Parser$3.call(Parser.java:294)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x03b5f9a8> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"SCR Component Actor" daemon prio=6 tid=0x307b1800 nid=0x1d34 in Object.wait() [0x3227f000..0x3227fa14]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0edeae38> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:485)
at org.apache.felix.scr.impl.ComponentActorThread.run(ComponentActorThread.java:74)
- locked <0x0edeae38> (a java.util.LinkedList)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"fileinstall-C:\glassfish\glassfish\domains\domain1/autodeploy/bundles/" daemon prio=6 tid=0x307cc000 nid=0x1c74 in Object.wait() [0x3222f000..0x3222fa94]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0edead90> (a org.apache.felix.fileinstall.internal.DirectoryWatcher)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.run(DirectoryWatcher.java:268)
- locked <0x0edead90> (a org.apache.felix.fileinstall.internal.DirectoryWatcher)

Locked ownable synchronizers:
- None

"DestroyJavaVM" prio=6 tid=0x002bac00 nid=0x1e7c waiting on condition [0x00000000..0x0090fd4c]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"GlassFish Kernel Main Thread" prio=6 tid=0x30101400 nid=0x148c in Object.wait() [0x321df000..0x321dfb14]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0edeacb8> (a com.sun.enterprise.v3.server.AppServerStartup$1)
at java.lang.Object.wait(Object.java:485)
at com.sun.enterprise.v3.server.AppServerStartup$1.run(AppServerStartup.java:153)
- locked <0x0edeacb8> (a com.sun.enterprise.v3.server.AppServerStartup$1)

Locked ownable synchronizers:
- None

"transaction-manager" daemon prio=6 tid=0x30ba9400 nid=0xc98 in Object.wait() [0x3218f000..0x3218fb94]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0edcbae0> (a java.util.TaskQueue)
at java.lang.Object.wait(Object.java:485)
at java.util.TimerThread.mainLoop(Timer.java:483)
- locked <0x0edcbae0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers:
- None

"AutoDeployer" daemon prio=6 tid=0x30b95000 nid=0x1c8 in Object.wait() [0x3213f000..0x3213fc14]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0eda3120> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x0eda3120> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers:
- None

"ping" daemon prio=6 tid=0x30b8d400 nid=0x13a4 in Object.wait() [0x31f0f000..0x31f0fd14]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0edd21f8> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x0edd21f8> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers:
- None

"RMI RenewClean-[16.60.222.169:8686]" daemon prio=6 tid=0x30b65400 nid=0x17d4 in Object.wait() [0x3209f000..0x3209fa14]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0ec32498> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
- locked <0x0ec32498> (a java.lang.ref.ReferenceQueue$Lock)
at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"RMI TCP Connection(5)-16.60.222.169" daemon prio=6 tid=0x30b5ec00 nid=0x18b8 runnable [0x3204f000..0x3204fa94]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0x03b42960> (a java.io.BufferedInputStream)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x0ec47a98> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"GC Daemon" daemon prio=2 tid=0x30b54000 nid=0x192c in Object.wait() [0x31fff000..0x31fffb14]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0ec34718> (a sun.misc.GC$LatencyLock)
at sun.misc.GC$Daemon.run(GC.java:100)
- locked <0x0ec34718> (a sun.misc.GC$LatencyLock)

Locked ownable synchronizers:
- None

"RMI Reaper" prio=6 tid=0x30b53400 nid=0xb20 in Object.wait() [0x31faf000..0x31fafb94]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0d659160> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
- locked <0x0d659160> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:333)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"RMI TCP Accept-8686" daemon prio=6 tid=0x30b4cc00 nid=0x1340 runnable [0x31f5f000..0x31f5fc14]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x0ec34770> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"DynamicReloader" daemon prio=6 tid=0x30b05c00 nid=0x1cf8 in Object.wait() [0x31dcf000..0x31dcfd14]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0ec348b0> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x0ec348b0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers:
- None

"fileinstall-C:\SVN\btoanywhere\server\runtime\target\btoaw\glassfish\glassfish/modules/autostart/" prio=6 tid=0x30b1bc00 nid=0x1868 waiting for monitor entry [0x31ebe000..0x31ebfa14]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.glassfish.admin.monitor.MonitoringBootstrap.registerProbes(MonitoringBootstrap.java:246)
- waiting to lock <0x0e537da0> (a org.glassfish.admin.monitor.MonitoringBootstrap)
at com.sun.enterprise.connectors.service.ConnectorService.loadDeferredResourceAdapter(ConnectorService.java:180)
at com.sun.enterprise.connectors.service.ConnectorService.loadResourcesAndItsRar(ConnectorService.java:147)
at com.sun.enterprise.connectors.service.ConnectorService.checkAndLoadPool(ConnectorService.java:324)
at com.sun.enterprise.connectors.service.ConnectorResourceAdminServiceImpl.createConnectorResource(ConnectorResourceAdminServiceImpl.java:100)
at com.sun.enterprise.connectors.ConnectorRuntime.createConnectorResource(ConnectorRuntime.java:296)
at com.sun.enterprise.resource.deployer.JdbcResourceDeployer.deployResource(JdbcResourceDeployer.java:106)
- locked <0x0ee93f00> (a com.sun.enterprise.resource.deployer.JdbcResourceDeployer)
at org.glassfish.javaee.services.ResourceProxy.create(ResourceProxy.java:90)
- locked <0x0edc2000> (a org.glassfish.javaee.services.ResourceProxy)
at com.sun.enterprise.naming.impl.SerialContext.lookup(SerialContext.java:507)
at com.sun.enterprise.naming.impl.SerialContext.lookup(SerialContext.java:455)
at javax.naming.InitialContext.lookup(InitialContext.java:392)
at javax.naming.InitialContext.lookup(InitialContext.java:392)
at org.glassfish.osgi.ee.resources.ResourceProxy.getActualObject(ResourceProxy.java:81)
at org.glassfish.osgi.ee.resources.ResourceProxy.invoke(ResourceProxy.java:69)
at $Proxy87.toString(Unknown Source)
at java.text.MessageFormat.subformat(MessageFormat.java:1246)
at java.text.MessageFormat.format(MessageFormat.java:836)
at java.text.Format.format(Format.java:140)
at java.text.MessageFormat.format(MessageFormat.java:812)
at com.sun.enterprise.server.logging.UniformLogFormatter.uniformLogFormat(UniformLogFormatter.java:289)
at com.sun.enterprise.server.logging.UniformLogFormatter.format(UniformLogFormatter.java:161)
at java.util.logging.StreamHandler.publish(StreamHandler.java:179)
- locked <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:88)
at java.util.logging.Logger.log(Logger.java:458)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.logp(Logger.java:649)
at org.jvnet.hk2.osgiadapter.HK2Main$HK2ServiceTrackerCustomizer.addingService(HK2Main.java:274)
at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:896)
at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:261)
at org.osgi.util.tracker.AbstractTracked.track(AbstractTracked.java:233)
at org.osgi.util.tracker.ServiceTracker$Tracked.serviceChanged(ServiceTracker.java:840)
at org.apache.felix.framework.util.EventDispatcher.invokeServiceListenerCallback(EventDispatcher.java:871)
at org.apache.felix.framework.util.EventDispatcher.fireEventImmediately(EventDispatcher.java:733)
at org.apache.felix.framework.util.EventDispatcher.fireServiceEvent(EventDispatcher.java:662)
at org.apache.felix.framework.Felix.fireServiceEvent(Felix.java:3769)
at org.apache.felix.framework.Felix.access$000(Felix.java:80)
at org.apache.felix.framework.Felix$2.serviceChanged(Felix.java:722)
at org.apache.felix.framework.ServiceRegistry.registerService(ServiceRegistry.java:107)
at org.apache.felix.framework.Felix.registerService(Felix.java:2854)
at org.apache.felix.framework.BundleContextImpl.registerService(BundleContextImpl.java:251)
at org.apache.felix.framework.BundleContextImpl.registerService(BundleContextImpl.java:229)
at org.glassfish.osgi.ee.resources.BaseResourceManager.registerResourceAsService(BaseResourceManager.java:131)
at org.glassfish.osgi.ee.resources.JDBCResourceManager.registerJdbcResource(JDBCResourceManager.java:110)
at org.glassfish.osgi.ee.resources.JDBCResourceManager.registerJdbcResources(JDBCResourceManager.java:74)
at org.glassfish.osgi.ee.resources.JDBCResourceManager.registerResources(JDBCResourceManager.java:62)
at org.glassfish.osgi.ee.resources.ResourceProviderService.registerResources(ResourceProviderService.java:114)
at org.glassfish.osgi.ee.resources.ResourcesExtender.start(ResourcesExtender.java:72)
at org.glassfish.osgijavaeebase.ExtenderManager$ExtenderTracker.addingService(ExtenderManager.java:142)
at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:896)
at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:261)
at org.osgi.util.tracker.AbstractTracked.trackInitial(AbstractTracked.java:184)
at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:339)
at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:273)
at org.glassfish.osgijavaeebase.ExtenderManager.startExtenders(ExtenderManager.java:108)
- locked <0x0ee94508> (a org.glassfish.osgijavaeebase.ExtenderManager)
at org.glassfish.osgijavaeebase.ExtenderManager.access$300(ExtenderManager.java:66)
at org.glassfish.osgijavaeebase.ExtenderManager$GlassFishServerTracker.addingService(ExtenderManager.java:185)
at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:896)
at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:261)
at org.osgi.util.tracker.AbstractTracked.trackInitial(AbstractTracked.java:184)
at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:339)
at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:273)
at org.glassfish.osgijavaeebase.ExtenderManager.start(ExtenderManager.java:85)
- locked <0x0ee94508> (a org.glassfish.osgijavaeebase.ExtenderManager)
at org.glassfish.osgijavaeebase.OSGiJavaEEActivator.start(OSGiJavaEEActivator.java:66)
at org.apache.felix.framework.util.SecureAction.startActivator(SecureAction.java:629)
at org.apache.felix.framework.Felix.activateBundle(Felix.java:1835)
at org.apache.felix.framework.Felix.startBundle(Felix.java:1752)
at org.apache.felix.framework.BundleImpl.start(BundleImpl.java:922)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.process(DirectoryWatcher.java:1175)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.process(DirectoryWatcher.java:1153)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.processAllBundles(DirectoryWatcher.java:1146)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.process(DirectoryWatcher.java:456)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.run(DirectoryWatcher.java:263)

Locked ownable synchronizers:
- None

"log-rotation-timer" prio=6 tid=0x2f0d5000 nid=0x1a10 in Object.wait() [0x31e6f000..0x31e6fa94]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0eb8f7e8> (a java.util.TaskQueue)
at java.lang.Object.wait(Object.java:485)
at java.util.TimerThread.mainLoop(Timer.java:483)
- locked <0x0eb8f7e8> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers:
- None

"telnetconsole.Listener" prio=6 tid=0x30b1c400 nid=0x1f38 runnable [0x31e1f000..0x31e1fb14]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x0eb8f840> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at org.apache.felix.shell.remote.Listener$Acceptor.run(Listener.java:150)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x30aea400 nid=0xda0 runnable [0x31b9f000..0x31b9fb14]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:274)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:256)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:137)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x0eadb288> (a sun.nio.ch.Util$1)
- locked <0x0eadb298> (a java.util.Collections$UnmodifiableSet)
- locked <0x0eadb210> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.sun.grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:513)
at com.sun.grizzly.SelectorHandlerRunner.doSelect(SelectorHandlerRunner.java:190)
at com.sun.grizzly.SelectorHandlerRunner.run(SelectorHandlerRunner.java:132)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x0eaf59e8> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"Thread-18" prio=10 tid=0x30ae1400 nid=0x1198 in Object.wait() [0x31b4f000..0x31b4fb94]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0eadb400> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.waitUntilSelectorHandlersStop(Controller.java:1105)
- locked <0x0eadb400> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.start(Controller.java:855)
at com.sun.grizzly.http.SelectorThread.startListener(SelectorThread.java:1277)
- locked <0x0eadb470> (a java.lang.Object)
at com.sun.grizzly.http.SelectorThread.run(SelectorThread.java:1117)
at com.sun.grizzly.http.SelectorThread.startEndpoint(SelectorThread.java:1204)
at com.sun.enterprise.v3.services.impl.GrizzlyListener.startEndpoint(GrizzlyListener.java:140)
at com.sun.enterprise.v3.services.impl.GrizzlyProxy$2.run(GrizzlyProxy.java:327)

Locked ownable synchronizers:
- None

"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x30ae2400 nid=0x184c runnable [0x31aff000..0x31affc14]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:274)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:256)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:137)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x0eade6a8> (a sun.nio.ch.Util$1)
- locked <0x0eade6b8> (a java.util.Collections$UnmodifiableSet)
- locked <0x0eade630> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.sun.grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:513)
at com.sun.grizzly.SelectorHandlerRunner.doSelect(SelectorHandlerRunner.java:190)
at com.sun.grizzly.SelectorHandlerRunner.run(SelectorHandlerRunner.java:132)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x0eaf6008> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"Thread-15" prio=10 tid=0x30add400 nid=0xa00 in Object.wait() [0x31aaf000..0x31aafc94]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0eade820> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.waitUntilSelectorHandlersStop(Controller.java:1105)
- locked <0x0eade820> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.start(Controller.java:855)
at com.sun.grizzly.http.SelectorThread.startListener(SelectorThread.java:1277)
- locked <0x0eade890> (a java.lang.Object)
at com.sun.grizzly.http.SelectorThread.run(SelectorThread.java:1117)
at com.sun.grizzly.http.SelectorThread.startEndpoint(SelectorThread.java:1204)
at com.sun.enterprise.v3.services.impl.GrizzlyListener.startEndpoint(GrizzlyListener.java:140)
at com.sun.enterprise.v3.services.impl.GrizzlyProxy$2.run(GrizzlyProxy.java:327)

Locked ownable synchronizers:
- None

"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x30ad3400 nid=0x1d54 runnable [0x31a5f000..0x31a5fd14]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:274)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:256)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:137)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x0eae1ac8> (a sun.nio.ch.Util$1)
- locked <0x0eae1ad8> (a java.util.Collections$UnmodifiableSet)
- locked <0x0eae1a50> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.sun.grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:513)
at com.sun.grizzly.SelectorHandlerRunner.doSelect(SelectorHandlerRunner.java:190)
at com.sun.grizzly.SelectorHandlerRunner.run(SelectorHandlerRunner.java:132)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x0eaf6588> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"Thread-12" prio=10 tid=0x30ab3800 nid=0x904 in Object.wait() [0x319ff000..0x319ffd94]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0eae1c38> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.waitUntilSelectorHandlersStop(Controller.java:1105)
- locked <0x0eae1c38> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.start(Controller.java:855)
at com.sun.grizzly.http.SelectorThread.startListener(SelectorThread.java:1277)
- locked <0x0e600ce0> (a java.lang.Object)
at com.sun.grizzly.http.SelectorThread.run(SelectorThread.java:1117)
at com.sun.grizzly.http.SelectorThread.startEndpoint(SelectorThread.java:1204)
at com.sun.enterprise.v3.services.impl.GrizzlyListener.startEndpoint(GrizzlyListener.java:142)
at com.sun.enterprise.v3.services.impl.GrizzlyProxy$2.run(GrizzlyProxy.java:327)

Locked ownable synchronizers:
- None

"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x30ac2c00 nid=0x11fc runnable [0x319af000..0x319afa14]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:274)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:256)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:137)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x0e603f40> (a sun.nio.ch.Util$1)
- locked <0x0e603f50> (a java.util.Collections$UnmodifiableSet)
- locked <0x0e603ec8> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.sun.grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:513)
at com.sun.grizzly.SelectorHandlerRunner.doSelect(SelectorHandlerRunner.java:190)
at com.sun.grizzly.SelectorHandlerRunner.run(SelectorHandlerRunner.java:132)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x0e7cf7b0> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x30ad6400 nid=0x185c runnable [0x3195f000..0x3195fa94]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:274)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:256)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:137)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x0e604148> (a sun.nio.ch.Util$1)
- locked <0x0e604158> (a java.util.Collections$UnmodifiableSet)
- locked <0x0e6040d0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.sun.grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:513)
at com.sun.grizzly.SelectorHandlerRunner.doSelect(SelectorHandlerRunner.java:190)
at com.sun.grizzly.SelectorHandlerRunner.run(SelectorHandlerRunner.java:132)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- <0x0e7cfac8> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"Thread-7" prio=10 tid=0x30ad5400 nid=0x1b8c in Object.wait() [0x3190f000..0x3190fb14]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0e6042b8> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.waitUntilSelectorHandlersStop(Controller.java:1105)
- locked <0x0e6042b8> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.start(Controller.java:855)
at com.sun.grizzly.http.SelectorThread.startListener(SelectorThread.java:1277)
- locked <0x0e604328> (a java.lang.Object)
at com.sun.grizzly.http.SelectorThread.run(SelectorThread.java:1117)
at com.sun.grizzly.http.SelectorThread.startEndpoint(SelectorThread.java:1204)
at com.sun.enterprise.v3.services.impl.GrizzlyListener.startEndpoint(GrizzlyListener.java:142)
at com.sun.enterprise.v3.services.impl.GrizzlyProxy$2.run(GrizzlyProxy.java:327)

Locked ownable synchronizers:
- None

"Thread-4" prio=10 tid=0x30a9f800 nid=0x1944 in Object.wait() [0x318bf000..0x318bfb94]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0e6044c8> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.waitUntilSelectorHandlersStop(Controller.java:1105)
- locked <0x0e6044c8> (a java.util.concurrent.atomic.AtomicInteger)
at com.sun.grizzly.Controller.start(Controller.java:855)
at com.sun.grizzly.http.SelectorThread.startListener(SelectorThread.java:1277)
- locked <0x0e604538> (a java.lang.Object)
at com.sun.grizzly.http.SelectorThread.run(SelectorThread.java:1117)
at com.sun.grizzly.http.SelectorThread.startEndpoint(SelectorThread.java:1204)
at com.sun.enterprise.v3.services.impl.GrizzlyListener.startEndpoint(GrizzlyListener.java:142)
at com.sun.enterprise.v3.services.impl.GrizzlyProxy$2.run(GrizzlyProxy.java:327)

Locked ownable synchronizers:
- None

"Thread-2" prio=6 tid=0x30915800 nid=0x19d8 waiting for monitor entry [0x3186f000..0x3186fc14]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.util.logging.StreamHandler.publish(StreamHandler.java:174)
- waiting to lock <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:88)
at java.util.logging.Logger.log(Logger.java:458)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.log(Logger.java:503)
at com.sun.logging.LogDomains$1.getResourceBundle(LogDomains.java:407)
at com.sun.enterprise.server.logging.UniformLogFormatter.getResourceBundle(UniformLogFormatter.java:339)
- locked <0x0e53fe28> (a com.sun.enterprise.server.logging.UniformLogFormatter)
at com.sun.enterprise.server.logging.UniformLogFormatter.uniformLogFormat(UniformLogFormatter.java:292)
at com.sun.enterprise.server.logging.UniformLogFormatter.format(UniformLogFormatter.java:161)
at java.util.logging.StreamHandler.publish(StreamHandler.java:179)
- locked <0x0e52f568> (a com.sun.enterprise.server.logging.GFFileHandler)
at com.sun.enterprise.server.logging.GFFileHandler.log(GFFileHandler.java:515)
at com.sun.enterprise.server.logging.GFFileHandler$1.run(GFFileHandler.java:166)

Locked ownable synchronizers:
- None

"pool-2-thread-1" daemon prio=6 tid=0x30a72c00 nid=0x1a74 waiting on condition [0x3181f000..0x3181fc94]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x0e52f5d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"Configuration Updater" daemon prio=6 tid=0x2fe7f400 nid=0x15a0 in Object.wait() [0x317cf000..0x317cfd14]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0de8dca8> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:485)
at org.apache.felix.cm.impl.UpdateThread.run(UpdateThread.java:67)
- locked <0x0de8dca8> (a java.util.LinkedList)

Locked ownable synchronizers:
- None

"JMX server connection timeout 18" daemon prio=6 tid=0x2fb82c00 nid=0x1c48 in Object.wait() [0x2ff6f000..0x2ff6fd94]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0d6827c8> (a [I)
at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150)
- locked <0x0d6827c8> (a [I)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"RMI Scheduler(0)" daemon prio=6 tid=0x2fb68400 nid=0x194c waiting on condition [0x2ff1f000..0x2ff1fa14]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x0d657468> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"RMI TCP Accept-0" daemon prio=6 tid=0x2fb4b400 nid=0x1528 runnable [0x2f45f000..0x2f45fb14]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x0d6779e0> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"FelixPackageAdmin" daemon prio=6 tid=0x2f14a400 nid=0x1e90 in Object.wait() [0x2f3ff000..0x2f3ffb94]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0d5ad650> (a org.apache.felix.framework.PackageAdminImpl)
at java.lang.Object.wait(Object.java:485)
at org.apache.felix.framework.PackageAdminImpl.run(PackageAdminImpl.java:321)
- locked <0x0d5ad650> (a org.apache.felix.framework.PackageAdminImpl)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"FelixStartLevel" daemon prio=6 tid=0x2f0f8400 nid=0xe9c in Object.wait() [0x2f3af000..0x2f3afc14]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0d5ad680> (a java.util.ArrayList)
at java.lang.Object.wait(Object.java:485)
at org.apache.felix.framework.StartLevelImpl.run(StartLevelImpl.java:242)
- locked <0x0d5ad680> (a java.util.ArrayList)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"FelixDispatchQueue" prio=6 tid=0x2f106800 nid=0x105c waiting for monitor entry [0x2fa3f000..0x2fa3fc94]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.util.logging.StreamHandler.publish(StreamHandler.java:174)
- waiting to lock <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:88)
at java.util.logging.Logger.log(Logger.java:458)
at com.sun.logging.LogDomains$1.log(LogDomains.java:354)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.log(Logger.java:503)
at java.util.logging.Logger.fine(Logger.java:1054)
at org.glassfish.admin.monitor.MonitoringBootstrap.addProvider(MonitoringBootstrap.java:281)
at org.glassfish.admin.monitor.MonitoringBootstrap.verifyModule(MonitoringBootstrap.java:235)
- locked <0x0e537da0> (a org.glassfish.admin.monitor.MonitoringBootstrap)
at org.glassfish.admin.monitor.MonitoringBootstrap.moduleResolved(MonitoringBootstrap.java:222)
at org.jvnet.hk2.osgiadapter.OSGiModulesRegistryImpl$3.bundleChanged(OSGiModulesRegistryImpl.java:514)
at org.apache.felix.framework.util.EventDispatcher.invokeBundleListenerCallback(EventDispatcher.java:807)
at org.apache.felix.framework.util.EventDispatcher.fireEventImmediately(EventDispatcher.java:729)
at org.apache.felix.framework.util.EventDispatcher.run(EventDispatcher.java:949)
at org.apache.felix.framework.util.EventDispatcher.access$000(EventDispatcher.java:54)
at org.apache.felix.framework.util.EventDispatcher$1.run(EventDispatcher.java:106)
at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers:
- None

"Low Memory Detector" daemon prio=6 tid=0x2f004400 nid=0x660 runnable [0x00000000..0x00000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"CompilerThread0" daemon prio=10 tid=0x2f001400 nid=0x103c waiting on condition [0x00000000..0x2f35f6bc]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"JDWP Event Helper Thread" daemon prio=6 tid=0x2eff5c00 nid=0x18ac runnable [0x00000000..0x00000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"JDWP Transport Listener: dt_socket" daemon prio=6 tid=0x2eff2800 nid=0x1b24 runnable [0x00000000..0x00000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"Attach Listener" daemon prio=10 tid=0x2ecb3400 nid=0x1284 runnable [0x00000000..0x2efcfb40]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"Signal Dispatcher" daemon prio=10 tid=0x2ecb2000 nid=0x1404 runnable [0x00000000..0x00000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"Finalizer" daemon prio=8 tid=0x2eca2000 nid=0x19bc in Object.wait() [0x2ef2f000..0x2ef2fc94]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0d55d218> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
- locked <0x0d55d218> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

Locked ownable synchronizers:
- None

"Reference Handler" daemon prio=10 tid=0x2ec9d400 nid=0x18a0 in Object.wait() [0x2eedf000..0x2eedfd14]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0d55d238> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x0d55d238> (a java.lang.ref.Reference$Lock)

Locked ownable synchronizers:
- None

"VM Thread" prio=10 tid=0x2ec99c00 nid=0x1e6c runnable

"VM Periodic Task Thread" prio=10 tid=0x2f017c00 nid=0x1b90 waiting on condition

JNI global references: 4574

Found one Java-level deadlock:
=============================
"pool-10-thread-1":
waiting to lock monitor 0x30b6ac2c (object 0x0e56f9d8, a java.util.logging.ConsoleHandler),
which is held by "fileinstall-C:\SVN\btoanywhere\server\runtime\target\btoaw\glassfish\glassfish/modules/autostart/"
"fileinstall-C:\SVN\btoanywhere\server\runtime\target\btoaw\glassfish\glassfish/modules/autostart/":
waiting to lock monitor 0x30b6a8ec (object 0x0e537da0, a org.glassfish.admin.monitor.MonitoringBootstrap),
which is held by "FelixDispatchQueue"
"FelixDispatchQueue":
waiting to lock monitor 0x30b6ac2c (object 0x0e56f9d8, a java.util.logging.ConsoleHandler),
which is held by "fileinstall-C:\SVN\btoanywhere\server\runtime\target\btoaw\glassfish\glassfish/modules/autostart/"

Java stack information for the threads listed above:
===================================================
"pool-10-thread-1":
at java.util.logging.StreamHandler.publish(StreamHandler.java:174)
- waiting to lock <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:88)
at java.util.logging.Logger.log(Logger.java:458)
at com.sun.logging.LogDomains$1.log(LogDomains.java:354)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.log(Logger.java:503)
at com.sun.enterprise.server.logging.LogManagerService$1.deleted(LogManagerService.java:368)
at org.glassfish.kernel.FileMonitoringImpl$2.run(FileMonitoringImpl.java:113)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
"fileinstall-C:\SVN\btoanywhere\server\runtime\target\btoaw\glassfish\glassfish/modules/autostart/":
at org.glassfish.admin.monitor.MonitoringBootstrap.registerProbes(MonitoringBootstrap.java:246)
- waiting to lock <0x0e537da0> (a org.glassfish.admin.monitor.MonitoringBootstrap)
at com.sun.enterprise.connectors.service.ConnectorService.loadDeferredResourceAdapter(ConnectorService.java:180)
at com.sun.enterprise.connectors.service.ConnectorService.loadResourcesAndItsRar(ConnectorService.java:147)
at com.sun.enterprise.connectors.service.ConnectorService.checkAndLoadPool(ConnectorService.java:324)
at com.sun.enterprise.connectors.service.ConnectorResourceAdminServiceImpl.createConnectorResource(ConnectorResourceAdminServiceImpl.java:100)
at com.sun.enterprise.connectors.ConnectorRuntime.createConnectorResource(ConnectorRuntime.java:296)
at com.sun.enterprise.resource.deployer.JdbcResourceDeployer.deployResource(JdbcResourceDeployer.java:106)
- locked <0x0ee93f00> (a com.sun.enterprise.resource.deployer.JdbcResourceDeployer)
at org.glassfish.javaee.services.ResourceProxy.create(ResourceProxy.java:90)
- locked <0x0edc2000> (a org.glassfish.javaee.services.ResourceProxy)
at com.sun.enterprise.naming.impl.SerialContext.lookup(SerialContext.java:507)
at com.sun.enterprise.naming.impl.SerialContext.lookup(SerialContext.java:455)
at javax.naming.InitialContext.lookup(InitialContext.java:392)
at javax.naming.InitialContext.lookup(InitialContext.java:392)
at org.glassfish.osgi.ee.resources.ResourceProxy.getActualObject(ResourceProxy.java:81)
at org.glassfish.osgi.ee.resources.ResourceProxy.invoke(ResourceProxy.java:69)
at $Proxy87.toString(Unknown Source)
at java.text.MessageFormat.subformat(MessageFormat.java:1246)
at java.text.MessageFormat.format(MessageFormat.java:836)
at java.text.Format.format(Format.java:140)
at java.text.MessageFormat.format(MessageFormat.java:812)
at com.sun.enterprise.server.logging.UniformLogFormatter.uniformLogFormat(UniformLogFormatter.java:289)
at com.sun.enterprise.server.logging.UniformLogFormatter.format(UniformLogFormatter.java:161)
at java.util.logging.StreamHandler.publish(StreamHandler.java:179)
- locked <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:88)
at java.util.logging.Logger.log(Logger.java:458)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.logp(Logger.java:649)
at org.jvnet.hk2.osgiadapter.HK2Main$HK2ServiceTrackerCustomizer.addingService(HK2Main.java:274)
at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:896)
at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:261)
at org.osgi.util.tracker.AbstractTracked.track(AbstractTracked.java:233)
at org.osgi.util.tracker.ServiceTracker$Tracked.serviceChanged(ServiceTracker.java:840)
at org.apache.felix.framework.util.EventDispatcher.invokeServiceListenerCallback(EventDispatcher.java:871)
at org.apache.felix.framework.util.EventDispatcher.fireEventImmediately(EventDispatcher.java:733)
at org.apache.felix.framework.util.EventDispatcher.fireServiceEvent(EventDispatcher.java:662)
at org.apache.felix.framework.Felix.fireServiceEvent(Felix.java:3769)
at org.apache.felix.framework.Felix.access$000(Felix.java:80)
at org.apache.felix.framework.Felix$2.serviceChanged(Felix.java:722)
at org.apache.felix.framework.ServiceRegistry.registerService(ServiceRegistry.java:107)
at org.apache.felix.framework.Felix.registerService(Felix.java:2854)
at org.apache.felix.framework.BundleContextImpl.registerService(BundleContextImpl.java:251)
at org.apache.felix.framework.BundleContextImpl.registerService(BundleContextImpl.java:229)
at org.glassfish.osgi.ee.resources.BaseResourceManager.registerResourceAsService(BaseResourceManager.java:131)
at org.glassfish.osgi.ee.resources.JDBCResourceManager.registerJdbcResource(JDBCResourceManager.java:110)
at org.glassfish.osgi.ee.resources.JDBCResourceManager.registerJdbcResources(JDBCResourceManager.java:74)
at org.glassfish.osgi.ee.resources.JDBCResourceManager.registerResources(JDBCResourceManager.java:62)
at org.glassfish.osgi.ee.resources.ResourceProviderService.registerResources(ResourceProviderService.java:114)
at org.glassfish.osgi.ee.resources.ResourcesExtender.start(ResourcesExtender.java:72)
at org.glassfish.osgijavaeebase.ExtenderManager$ExtenderTracker.addingService(ExtenderManager.java:142)
at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:896)
at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:261)
at org.osgi.util.tracker.AbstractTracked.trackInitial(AbstractTracked.java:184)
at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:339)
at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:273)
at org.glassfish.osgijavaeebase.ExtenderManager.startExtenders(ExtenderManager.java:108)
- locked <0x0ee94508> (a org.glassfish.osgijavaeebase.ExtenderManager)
at org.glassfish.osgijavaeebase.ExtenderManager.access$300(ExtenderManager.java:66)
at org.glassfish.osgijavaeebase.ExtenderManager$GlassFishServerTracker.addingService(ExtenderManager.java:185)
at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:896)
at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:261)
at org.osgi.util.tracker.AbstractTracked.trackInitial(AbstractTracked.java:184)
at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:339)
at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:273)
at org.glassfish.osgijavaeebase.ExtenderManager.start(ExtenderManager.java:85)
- locked <0x0ee94508> (a org.glassfish.osgijavaeebase.ExtenderManager)
at org.glassfish.osgijavaeebase.OSGiJavaEEActivator.start(OSGiJavaEEActivator.java:66)
at org.apache.felix.framework.util.SecureAction.startActivator(SecureAction.java:629)
at org.apache.felix.framework.Felix.activateBundle(Felix.java:1835)
at org.apache.felix.framework.Felix.startBundle(Felix.java:1752)
at org.apache.felix.framework.BundleImpl.start(BundleImpl.java:922)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.process(DirectoryWatcher.java:1175)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.process(DirectoryWatcher.java:1153)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.processAllBundles(DirectoryWatcher.java:1146)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.process(DirectoryWatcher.java:456)
at org.apache.felix.fileinstall.internal.DirectoryWatcher.run(DirectoryWatcher.java:263)
"FelixDispatchQueue":
at java.util.logging.StreamHandler.publish(StreamHandler.java:174)
- waiting to lock <0x0e56f9d8> (a java.util.logging.ConsoleHandler)
at java.util.logging.ConsoleHandler.publish(ConsoleHandler.java:88)
at java.util.logging.Logger.log(Logger.java:458)
at com.sun.logging.LogDomains$1.log(LogDomains.java:354)
at java.util.logging.Logger.doLog(Logger.java:480)
at java.util.logging.Logger.log(Logger.java:503)
at java.util.logging.Logger.fine(Logger.java:1054)
at org.glassfish.admin.monitor.MonitoringBootstrap.addProvider(MonitoringBootstrap.java:281)
at org.glassfish.admin.monitor.MonitoringBootstrap.verifyModule(MonitoringBootstrap.java:235)
- locked <0x0e537da0> (a org.glassfish.admin.monitor.MonitoringBootstrap)
at org.glassfish.admin.monitor.MonitoringBootstrap.moduleResolved(MonitoringBootstrap.java:222)
at org.jvnet.hk2.osgiadapter.OSGiModulesRegistryImpl$3.bundleChanged(OSGiModulesRegistryImpl.java:514)
at org.apache.felix.framework.util.EventDispatcher.invokeBundleListenerCallback(EventDispatcher.java:807)
at org.apache.felix.framework.util.EventDispatcher.fireEventImmediately(EventDispatcher.java:729)
at org.apache.felix.framework.util.EventDispatcher.run(EventDispatcher.java:949)
at org.apache.felix.framework.util.EventDispatcher.access$000(EventDispatcher.java:54)
at org.apache.felix.framework.util.EventDispatcher$1.run(EventDispatcher.java:106)
at java.lang.Thread.run(Thread.java:619)

Found 1 deadlock.

Reply viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
ss141213
Offline
Joined: 2005-03-30
Points: 0

I have seen similar deadlocks involving logging code. e.g., see:

http://java.net/jira/browse/GLASSFISH-13232

It was later on closed as a duplicate of:
http://java.net/jira/browse/GLASSFISH-13877

The latter bug is fixed, but I think the root cause is not fixed.
Looking at your stack trace, I see some logging level has been set to
FINE or higher. Can you try resetting them to INFO? That may just avoid
the problem. If it does, you may like to reopen 13877.

Thanks,
Sahoo

On Tuesday 03 May 2011 04:43 PM, forums@java.net wrote:
> Hi,
>
> I am using glassfish3.1 GA build with felix. If I remove temporary files
> (from generated and osgi-cache folders) and start a server, I get a
> deadlock
> (the log is attached below).

okna2000
Offline
Joined: 2009-07-19
Points: 0

Hi Sahoo,
The issue is resolved if I reset logging level to INFO. What is the procedure to reopen bugs?

thanks

ss141213
Offline
Joined: 2005-03-30
Points: 0

There should be a link available to reopen when you go to the issue
page. Pl. do mention about the work around so that others can benefit
from it as well. Thanks for confirming,

Sahoo
On Wednesday 04 May 2011 12:28 PM, forums@java.net wrote:
> Hi Sahoo,
>
> The issue is resolved if I reset logging level to INFO. What is the
> procedure
> to reopen bugs?
>
>
>
> thanks
>
>
> --
>
> [Message sent by forum member 'okna2000']
>
> View Post: http://forums.java.net/node/797659
>
>

okna2000
Offline
Joined: 2009-07-19
Points: 0

Hi Sahoo,
I dont have a reopen link. I do have "clone" / "comment" / "create sub-task", but no "reopen". I need owner permissions to reopen it?

ss141213
Offline
Joined: 2005-03-30
Points: 0

I don't understand JIRA that well. I reopened it. You can subscribe to
it to see progress.

Thanks for reporting the issue,
Sahoo
On Thursday 05 May 2011 12:19 PM, forums@java.net wrote:
> Hi Sahoo,
> I dont have a reopen link. I do have "clone" / "comment" / "create
> sub-task", but no "reopen". I need owner permissions to reopen it?
>
>
> --
>
> [Message sent by forum member 'okna2000']
>
> View Post: http://forums.java.net/node/797659
>
>