Missed Team ’24? Catch up on announcements here.

×
Create
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in
Products
See all
Community resources
Top groups
Explore all groups
Community resources
Learn
Community resources
Events
Community resources

Stash 500. How to manage "Hazelcast instance is not active!" appeared in log?

Dana
Dana
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
Get recognized
August 11, 2014

Suddenly today Stash was broken with Hazelcast Exception. Firsly it appeared in log from UPManager:

2014-08-12 09:29:12,504 WARN  [AtlassianEvent::thread-10] @1RX1V5Cx569x6907953x75 2a02:6b8:0:1a16::500:2c,127.0.0.1 "GET /scm/stardust/browser-server-api-resources.git/info/refs HTTP/1.0" c.a.a.c.c.AnalyticsConfig Couldn't check the analytics settings. This can safely be ignored during plugin shutdown. Detail: Hazelcast instance is not active!
2014-08-12 09:29:12,506 ERROR [clusterScheduler_QuartzSchedulerThread]  o.quartz.core.QuartzSchedulerThread quartzSchedulerThreadLoop: RuntimeException Hazelcast instance is not active!
com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active!
	at com.hazelcast.spi.AbstractDistributedObject.throwNotActiveException(AbstractDistributedObject.java:81) ~[hazelcast-3.3-RC2.jar:3.3-RC2]
	at com.hazelcast.spi.AbstractDistributedObject.lifecycleCheck(AbstractDistributedObject.java:76) ~[hazelcast-3.3-RC2.jar:3.3-RC2]
	at com.hazelcast.spi.AbstractDistributedObject.getNodeEngine(AbstractDistributedObject.java:70) ~[hazelcast-3.3-RC2.jar:3.3-RC2]
	at com.hazelcast.map.proxy.MapProxyImpl.isLocked(MapProxyImpl.java:303) ~[hazelcast-3.3-RC2.jar:3.3-RC2]
	at com.atlassian.stash.internal.quartz.HazelcastJobStore.acquireNextTrigger(HazelcastJobStore.java:45) ~[stash-platform-3.2.0.jar:na]
	at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:263) ~[quartz-1.8.6.jar:na]
2014-08-12 09:29:12,506 WARN  [clusterScheduler_Worker-6]  c.a.u.n.PluginRequestNotificationCheckerImpl Error getting plugin request notifications
com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active!
	at com.hazelcast.spi.AbstractDistributedObject.throwNotActiveException(AbstractDistributedObject.java:81) ~[hazelcast-3.3-RC2.jar:3.3-RC2]
	at com.hazelcast.spi.AbstractDistributedObject.lifecycleCheck(AbstractDistributedObject.java:76) ~[hazelcast-3.3-RC2.jar:3.3-RC2]
	at com.hazelcast.spi.AbstractDistributedObject.getNodeEngine(AbstractDistributedObject.java:70) ~[hazelcast-3.3-RC2.jar:3.3-RC2]
	at com.hazelcast.concurrent.lock.LockProxy.lock(LockProxy.java:70) ~[hazelcast-3.3-RC2.jar:3.3-RC2]
	at com.atlassian.beehive.hazelcast.HazelcastClusterLock.lock(HazelcastClusterLock.java:30) ~[beehive-hazelcast-0.1.3.jar:na]
	at com.atlassian.beehive.compat.delegate.DelegatingClusterLock.lock(DelegatingClusterLock.java:34) ~[atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.upm.impl.Locks.runWithLock(Locks.java:114) ~[atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.upm.impl.Locks.readWithLock(Locks.java:109) ~[atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.upm.request.PluginSettingsPluginRequestStore.getRequests(PluginSettingsPluginRequestStore.java:111) ~[atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.upm.notification.PluginRequestNotificationCheckerImpl.updatePluginRequestNotifications(PluginRequestNotificationCheckerImpl.java:33) ~[atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.upm.schedule.PluginRequestCheckJob.executeInternal(PluginRequestCheckJob.java:35) [atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.upm.schedule.AbstractUpmScheduledJob.execute(AbstractUpmScheduledJob.java:53) [atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.upm.schedule.AbstractUpmScheduledJob.execute(AbstractUpmScheduledJob.java:44) [atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.scheduler.compat.clustered.ClusteredJobRunner.runJob(ClusteredJobRunner.java:54) [atlassian-universal-plugin-manager-plugin-2.17.8_1406676252000.jar:na]
	at com.atlassian.scheduler.core.JobLauncher.runJob(JobLauncher.java:127) [atlassian-scheduler-core-1.2.2.jar:na]
	at com.atlassian.scheduler.core.JobLauncher.launchAndBuildResponse(JobLauncher.java:101) [atlassian-scheduler-core-1.2.2.jar:na]
	at com.atlassian.scheduler.core.JobLauncher.launch(JobLauncher.java:80) [atlassian-scheduler-core-1.2.2.jar:na]
	at com.atlassian.scheduler.quartz1.Quartz1Job.execute(Quartz1Job.java:32) [atlassian-scheduler-quartz1-1.2.2.jar:na]
	at org.quartz.core.JobRunShell.run(JobRunShell.java:223) [quartz-1.8.6.jar:na]
	at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549) [quartz-1.8.6.jar:na]
2014-08-12 09:29:12,507 WARN  [AtlassianEvent::thread-25] @1RX1V5Cx569x6907959x81 2a02:6b8:b010:4000::26,127.0.0.1 "GET /scm/stardust/browser-server-api-resources.git/info/refs HTTP/1.0" c.a.a.c.c.AnalyticsConfig Couldn't check the analytics settings. This can safely be ignored during plugin shutdown. Detail: Hazelcast instance is not active!

How to manage it? What could be the reason? We have UPManager last version installed.

Watch
Like Deleted user likes this
2084 views

4 answers

Comments for this post are closed

Community moderators have prevented the ability to post new answers.

Post a new question

0 votes
Ronnie Otts
Ronnie Otts January 7, 2015

I am seeing the same in my stash logs, also version 3.3.0.

 

Exception in thread "rescope:thread-28695" com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active!
Exception in thread "rescope:thread-28712" Exception in thread "rescope:thread-28711" Exception in thread "rescope:thread-28710" Exception in thread "rescope:thread-28709" Exception in thread "rescope:thread-28708" Exception in thread "rescope:thread-28707" Exception in thread "rescope:thread-28706" Exception in thread "rescope:thread-28705" Exception in thread "rescope:thread-28704" Exception in thread "rescope:thread-28703" Exception in thread "rescope:thread-28702" Exception in thread "rescope:thread-28714" Exception in thread "rescope:thread-28701" Exception in thread "rescope:thread-28700" Exception in thread "rescope:thread-28699" Exception in thread "rescope:thread-28698" Exception in thread "rescope:thread-28697" Exception in thread "rescope:thread-28696" Exception in thread "rescope:thread-28715" Exception in thread "rescope:thread-28713" 	at com.hazelcast.spi.AbstractDistributedObject.throwNotActiveException(AbstractDistributedObject.java:81)
	at com.hazelcast.spi.AbstractDistributedObject.lifecycleCheck(AbstractDistributedObject.java:76)
	at com.hazelcast.spi.AbstractDistributedObject.getNodeEngine(AbstractDistributedObject.java:70)
	at com.hazelcast.queue.proxy.QueueProxyImpl.poll(QueueProxyImpl.java:85)
	at com.hazelcast.queue.proxy.QueueProxyImpl.take(QueueProxyImpl.java:80)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active!
	at com.hazelcast.spi.AbstractDistributedObject.throwNotActiveException(AbstractDistributedObject.java:81)
	at com.hazelcast.spi.AbstractDistributedObject.lifecycleCheck(AbstractDistributedObject.java:76)
	at com.hazelcast.spi.AbstractDistributedObject.getNodeEngine(AbstractDistributedObject.java:70)
	at com.hazelcast.queue.proxy.QueueProxyImpl.poll(QueueProxyImpl.java:85)
	at com.hazelcast.queue.proxy.QueueProxyImpl.take(QueueProxyImpl.java:80)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
View More Comments
Basavaraj Kolli (GTNx)
Basavaraj Kolli (GTNx)
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
Get involved
February 9, 2015

Is there an update to this request. I am also having same issue with the version 3.5.0

Like
Basavaraj Kolli (GTNx)
Basavaraj Kolli (GTNx)
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
Get involved
February 9, 2015

at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:136) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:88) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:526) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1078) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:655) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:222) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1566) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1523) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active! at com.hazelcast.spi.AbstractDistributedObject.getService(AbstractDistributedObject.java:93) at com.hazelcast.map.proxy.MapProxySupport.toData(MapProxySupport.java:1056) at com.hazelcast.map.proxy.MapProxyImpl.get(MapProxyImpl.java:83) at com.atlassian.cache.hazelcast.HazelcastCachedReference.get(HazelcastCachedReference.java:78) ... 144 more 09-Feb-2015 14:14:10.834 SEVERE [http-nio-443-exec-16] org.apache.catalina.core.ApplicationDispatcher.invoke Servlet.service() for servlet springMvc threw exception com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active! at com.hazelcast.spi.AbstractDistributedObject.getService(AbstractDistributedObject.java:93) at com.hazelcast.map.proxy.MapProxySupport.toData(MapProxySupport.java:1056) at com.hazelcast.map.proxy.MapProxyImpl.get(MapProxyImpl.java:83) at com.atlassian.cache.hazelcast.HazelcastCache.getOrLoad(HazelcastCache.java:228) at com.atlassian.cache.hazelcast.HazelcastCache.get(HazelcastCache.java:93) at com.atlassian.stash.internal.server.ApplicationPropertiesServiceImpl.getProperty(ApplicationPropertiesServiceImpl.java:599) at com.atlassian.stash.internal.server.ApplicationPropertiesServiceImpl.getLocale(ApplicationPropertiesServiceImpl.java:214) at sun.reflect.GeneratedMethodAccessor338.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:201) at com.sun.proxy.$Proxy142.getLocale(Unknown Source) at com.atlassian.stash.internal.i18n.DefaultLocaleHolder.getLocales(DefaultLocaleHolder.java:56) at com.atlassian.stash.internal.i18n.CriticalLocaleHolder.getLocales(CriticalLocaleHolder.java:22) at com.atlassian.stash.internal.i18n.PluginI18nService.getText(PluginI18nService.java:119) at com.atlassian.stash.internal.web.i18n.I18nMessageSource.getMessage(I18nMessageSource.java:48) at org.springframework.context.support.AbstractApplicationContext.getMessage(AbstractApplicationContext.java:1117) at org.springframework.context.support.MessageSourceAccessor.getMessage(MessageSourceAccessor.java:105) at org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:199) at com.atlassian.stash.internal.spring.security.StashAuthenticationFilter.doFilter(StashAuthenticationFilter.java:100)

Like
Reply
0 votes
ThiagoBomfim
ThiagoBomfim
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
September 11, 2014

Hello!

Could you please raise an issue in http://support.atlassian.com so we can investigate your logs more closely?

Thank you!

Best regards,
Thiago Bomfim
Atlassian Support

View More Comments
Mark Lang
Mark Lang November 5, 2014

I just ran into this issue as well on 3.3.0. I uploaded my catalina.out and atlassian-stash.logs - https://support.atlassian.com/servicedesk/customer/portal/24/SSP-6248

Like
Reply
0 votes
Anoop Bansal
Anoop Bansal September 10, 2014

i too have this HTTP Status 500 - Hazelcast instance is not active! issue coming. Our server keeps going donw with this error. Pls suggest

Reply
0 votes
BenW
BenW
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
August 12, 2014

Hi Dana, I see from the logs that you're running UPM 2.17.8. What version of Stash are you running?

Reply

Comments for this post are closed

Community moderators have prevented the ability to post new answers.

Post a new question

Atlassian logo
Answers Developer Questions
TAGS
AUG Leaders

Atlassian Community Events

    See all events