Create
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in
Products
See all
Community resources
Top groups
Explore all groups
Community resources
Learn
Community resources
Events
Community resources

Bitbucket shuts itself down hourly?

Patrick Neuner - Futureweb GmbH
Patrick Neuner - Futureweb GmbH October 3, 2018

Hey there,

I got a Problem with Bitbucket v5.13.1 (Server, Self-Hosted) - it shut's down itself every Hour - without any Error ...

 

Log:

2018-10-03 18:02:47,369 INFO  [main]  o.s.boot.SpringApplication
  .   ____          _            __ _ _
 /\\ / ___'_ __ _ _(_)_ __  __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
 \\/  ___)| |_)| | | | | || (_| |  ) ) ) )
  '  |____| .__|_| |_|_| |_\__, | / / / /
 =========|_|==============|___/=/_/_/_/
 :: Spring Boot ::       (v1.5.12.RELEASE)


2018-10-03 18:02:47,556 INFO  [main]  c.a.b.i.b.BitbucketServerApplication Starting BitbucketServerApplication on jira.futureweb.at with PID 18998 (/opt/atlassian/bitbucket/5.13.1/app/WEB-INF/classes started by atlbitbucket in /)
2018-10-03 18:02:47,556 INFO  [main]  c.a.b.i.b.BitbucketServerApplication No active profile set, falling back to default profiles: default
2018-10-03 18:02:48,504 INFO  [main]  c.a.b.i.boot.log.BuildInfoLogger Starting Bitbucket 5.13.1 (2c2ed6e built on Tue Aug 21 07:11:42 CEST 2018)
2018-10-03 18:02:48,504 INFO  [main]  c.a.b.i.boot.log.BuildInfoLogger JVM: Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_172-b11
2018-10-03 18:02:50,521 INFO  [main]  c.a.b.i.b.BitbucketServerApplication Started BitbucketServerApplication in 3.786 seconds (JVM running for 5.929)
2018-10-03 18:02:53,540 INFO  [spring-startup]  c.a.s.internal.home.HomeLockAcquirer Successfully acquired lock on home directory /var/atlassian/application-data/bitbucket
2018-10-03 18:02:57,835 INFO  [spring-startup]  c.a.s.internal.home.HomeLockAcquirer Successfully acquired lock on home directory /var/atlassian/application-data/bitbucket/shared
2018-10-03 18:02:59,639 WARN  [spring-startup]  com.hazelcast.instance.Node [0.0.0.0]:5701 [atlbitbucket] [3.7.4-atlassian-43] No join method is enabled! Starting standalone.
2018-10-03 18:03:15,453 INFO  [spring-startup]  c.a.s.i.hook.DefaultHookService Hook callback socket listening on 127.0.0.1:39608
2018-10-03 18:03:17,274 INFO  [spring-startup]  c.a.s.i.s.g.t.DefaultTranscodeServer Callback socket listening at 127.0.0.1:38808
2018-10-03 18:03:28,316 INFO  [ThreadPoolAsyncTaskExecutor::Thread 3]  c.a.b.internal.ssh.server.SshServer Using MINA NIO service factory
2018-10-03 18:03:33,108 WARN  [spring-startup]  c.a.s.i.p.s.OsgiBundledPathScanner Cannot scan directory /com/atlassian/oauth/shared/servlet/ in bundle com.atlassian.oauth.atlassian-oauth-service-provider-plugin; it does not exist
2018-10-03 18:03:34,417 WARN  [spring-startup]  c.a.s.i.p.s.OsgiBundledPathScanner Cannot scan directory /com/atlassian/oauth/shared/servlet/ in bundle tac.bitbucket.languages.de_DE; it does not exist
2018-10-03 18:03:34,424 WARN  [spring-startup]  c.a.s.i.p.s.OsgiBundledPathScanner Cannot scan directory /com/atlassian/oauth/shared/servlet/ in bundle tac.bitbucket.languages.fr_FR; it does not exist
2018-10-03 18:03:34,430 WARN  [spring-startup]  c.a.s.i.p.s.OsgiBundledPathScanner Cannot scan directory /com/atlassian/oauth/shared/servlet/ in bundle tac.bitbucket.languages.ja_JP; it does not exist
2018-10-03 18:03:34,673 INFO  [spring-startup]  c.a.b.internal.ssh.server.SshServer Starting SSH server on port 7999...
2018-10-03 18:03:34,720 INFO  [spring-startup]  c.a.b.internal.ssh.server.SshServer Started SSH server successfully.
2018-10-03 18:03:35,054 INFO  [spring-startup]  c.a.b.i.s.c.j.c.HealthCheckRunner New health check registered: KnownIssueCheck
2018-10-03 18:03:35,055 INFO  [spring-startup]  c.a.b.i.s.c.j.c.HealthCheckRunner New health check registered: SearchIndexCheck
2018-10-03 18:03:35,055 INFO  [spring-startup]  c.a.b.i.s.c.c.DefaultClusterJobManager Registering job for ElasticsearchSynchronizeJob
2018-10-03 18:03:35,056 INFO  [spring-startup]  c.a.b.i.s.i.e.DefaultIndexEventQueueProcessor Event queue processor has been started
2018-10-03 18:03:35,061 INFO  [spring-startup]  c.a.b.i.s.c.j.c.HealthCheckRunner New health check registered: AuthenticationCheck
2018-10-03 18:03:35,061 INFO  [spring-startup]  c.a.b.i.s.c.c.DefaultClusterJobManager Registering job for StartupChecksJob
2018-10-03 18:03:35,214 INFO  [spring-startup]  c.a.s.internal.scm.PluginScmService Bitbucket is using /bin/git version 2.16.4
2018-10-03 18:03:35,267 INFO  [spring-startup]  c.a.s.i.hazelcast.HazelcastLifecycle Updating Hazelcast instance capabilities
2018-10-03 18:03:36,246 WARN  [UpmScheduler:thread-1]  com.atlassian.upm.pac.PacClientImpl Update check request may take longer because of the number of add-ons
2018-10-03 18:03:44,959 INFO  [Caesium-1-4]  c.a.b.i.s.c.j.c.HealthCheckRunner Running up to 3 search health checks
2018-10-03 18:03:45,079 INFO  [Caesium-1-2]  c.a.b.i.s.i.jobs.StartupChecksJob Attempting provisioning in startup job
2018-10-03 18:03:45,081 INFO  [Caesium-1-2]  c.a.b.i.s.i.jobs.StartupChecksJob Running startup jobs for search
2018-10-03 18:03:45,129 INFO  [I/O dispatcher 1]  c.a.b.s.s.t.DefaultElasticsearchConnectionTester Connected to Elasticsearch version 5.5.3
2018-10-03 18:03:45,176 INFO  [Caesium-1-4]  c.a.b.i.s.c.j.c.HealthCheckRunner Health checks will run again after PT5M
2018-10-03 18:08:45,006 INFO  [Caesium-1-4]  c.a.b.i.s.c.j.c.HealthCheckRunner Running up to 2 search health checks
2018-10-03 18:08:45,029 INFO  [I/O dispatcher 81]  c.a.b.s.s.t.DefaultElasticsearchConnectionTester Connected to Elasticsearch version 5.5.3
2018-10-03 18:08:45,043 INFO  [Caesium-1-4]  c.a.b.i.s.c.j.c.HealthCheckRunner Health checks will run again after PT5M
2018-10-03 18:13:45,006 INFO  [Caesium-1-4]  c.a.b.i.s.c.j.c.HealthCheckRunner Running up to 2 search health checks
2018-10-03 18:13:45,111 INFO  [I/O dispatcher 121]  c.a.b.s.s.t.DefaultElasticsearchConnectionTester Connected to Elasticsearch version 5.5.3
2018-10-03 18:13:45,126 INFO  [Caesium-1-4]  c.a.b.i.s.c.j.c.HealthCheckRunner Health checks will run again after PT10M
2018-10-03 18:23:45,008 INFO  [Caesium-1-4]  c.a.b.i.s.c.j.c.HealthCheckRunner Running up to 2 search health checks
2018-10-03 18:23:45,031 INFO  [I/O dispatcher 161]  c.a.b.s.s.t.DefaultElasticsearchConnectionTester Connected to Elasticsearch version 5.5.3
2018-10-03 18:23:45,045 INFO  [Caesium-1-4]  c.a.b.i.s.c.j.c.HealthCheckRunner Health checks will run again after PT20M
2018-10-03 18:43:45,007 INFO  [Caesium-1-2]  c.a.b.i.s.c.j.c.HealthCheckRunner Running up to 2 search health checks
2018-10-03 18:43:45,030 INFO  [I/O dispatcher 201]  c.a.b.s.s.t.DefaultElasticsearchConnectionTester Connected to Elasticsearch version 5.5.3
2018-10-03 18:43:45,043 INFO  [Caesium-1-2]  c.a.b.i.s.c.j.c.HealthCheckRunner Health checks will run again after PT40M
2018-10-03 19:00:01,120 INFO  [Thread-5]  c.a.b.i.boot.log.BuildInfoLogger Bitbucket 5.13.1 has shut down
2018-10-03 19:00:03,323 INFO  [localhost-startStop-2]  c.a.b.i.s.i.e.DefaultIndexEventQueueProcessor Worker thread has been shut down
2018-10-03 19:00:03,888 INFO  [Gemini Blueprint context shutdown thread1]  c.a.b.internal.ssh.server.SshServer Stopping SSH server...
2018-10-03 19:00:03,894 INFO  [Gemini Blueprint context shutdown thread1]  c.a.b.internal.ssh.server.SshServer Stopped SSH server successfully.
2018-10-03 19:00:04,461 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'rome.rome-1.0', not ACTIVE
2018-10-03 19:00:04,462 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'org.scala-lang.scala-library-2.12.1.v20161205-104509-VFINAL-2787b47', not ACTIVE
2018-10-03 19:00:04,462 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.springsource.org.jdom-1.1.0', not ACTIVE
2018-10-03 19:00:04,462 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.springsource.net.jcip.annotations-1.0.0', not ACTIVE
2018-10-03 19:00:04,462 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.atlassian.util.concurrent.atlassian-util-concurrent-3.0.0', not ACTIVE
2018-10-03 19:00:04,466 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.atlassian.plugin.atlassian-spring-scanner-runtime', not ACTIVE
2018-10-03 19:00:04,466 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.atlassian.plugin.atlassian-spring-scanner-annotation', not ACTIVE
2018-10-03 19:00:04,467 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.atlassian.bundles.json-20070829.0.0.1', not ACTIVE
2018-10-03 19:00:04,520 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 19:00:04,521 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 19:00:04,523 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 19:00:04,555 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 19:00:04,556 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 19:00:04,559 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 19:00:04,563 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 19:00:04,565 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 19:00:04,662 INFO  [localhost-startStop-2]  c.a.s.internal.home.HomeLockAcquirer Releasing lock on /var/atlassian/application-data/bitbucket/shared
2018-10-03 19:00:04,667 INFO  [localhost-startStop-2]  c.a.s.internal.home.HomeLockAcquirer Releasing lock on /var/atlassian/application-data/bitbucket

 

Hope someone can help me on this?

thx, bye from Austria

Andreas Schnederle-Wagner

Answer
Watch
Like Be the first to like this
614 views

2 answers

1 accepted

1 vote
Answer accepted
Christian Glockner
Christian Glockner
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
October 4, 2018

Hi,

Given that this happens at the top of every hour the most likely explanation is that you have some sort of cron job that shuts the service down or restarts it.

Cheers,

Christian

Premier Support Engineer

Atlassian

View More Comments
Patrick Neuner - Futureweb GmbH
Patrick Neuner - Futureweb GmbH October 4, 2018

Hey there,

seems like it has to do with a Bugfix for a systemd Bug ...

(https://support.plesk.com/hc/en-us/articles/115004603434-systemd-causes-high-CPU-load)

 

Bugfix is following cron:

/usr/bin/systemctl | /usr/bin/grep abandoned | /usr/bin/grep -e "[[:digit:]]" | /usr/bin/sed "s/.scope.*/.scope/" | /usr/bin/xargs /usr/bin/systemctl stop

 

and it seems like session-c4.scope is "abandoned" - but when stoped by cron it will shutdown Bitbucket

/usr/bin/systemctl | /usr/bin/grep abandoned
  session-c4.scope                                         loaded active     abandoned Session c4 of user atlbitbucket

So this could possibly hit all Red Hat/Centos Users which implemented this Bugfix ...

But why does Bitbucket relay on an abandoned Unit?!

 

thx

Andreas

Like
Reply
0 votes
Patrick Neuner - Futureweb GmbH
Patrick Neuner - Futureweb GmbH October 3, 2018

20:00 - and again Bitbucket stopped itself?

2018-10-03 20:00:01,971 INFO  [Thread-5]  c.a.b.i.boot.log.BuildInfoLogger Bitbucket 5.13.1 has shut down
2018-10-03 20:00:04,157 INFO  [localhost-startStop-2]  c.a.b.i.s.i.e.DefaultIndexEventQueueProcessor Worker thread has been shut down
2018-10-03 20:00:04,814 INFO  [Gemini Blueprint context shutdown thread1]  c.a.b.internal.ssh.server.SshServer Stopping SSH server...
2018-10-03 20:00:04,821 INFO  [Gemini Blueprint context shutdown thread1]  c.a.b.internal.ssh.server.SshServer Stopped SSH server successfully.
2018-10-03 20:00:05,427 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'rome.rome-1.0', not ACTIVE
2018-10-03 20:00:05,428 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'org.scala-lang.scala-library-2.12.1.v20161205-104509-VFINAL-2787b47', not ACTIVE
2018-10-03 20:00:05,428 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.springsource.org.jdom-1.1.0', not ACTIVE
2018-10-03 20:00:05,428 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.springsource.net.jcip.annotations-1.0.0', not ACTIVE
2018-10-03 20:00:05,428 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.atlassian.util.concurrent.atlassian-util-concurrent-3.0.0', not ACTIVE
2018-10-03 20:00:05,432 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.atlassian.plugin.atlassian-spring-scanner-runtime', not ACTIVE
2018-10-03 20:00:05,432 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.atlassian.plugin.atlassian-spring-scanner-annotation', not ACTIVE
2018-10-03 20:00:05,433 WARN  [FelixStartLevel]  c.a.p.osgi.factory.OsgiBundlePlugin Cannot disable Bundle 'com.atlassian.bundles.json-20070829.0.0.1', not ACTIVE
2018-10-03 20:00:05,487 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 20:00:05,487 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 20:00:05,491 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 20:00:05,527 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 20:00:05,528 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 20:00:05,531 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 20:00:05,535 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 20:00:05,537 WARN  [localhost-startStop-2]  c.a.p.osgi.factory.OsgiBundlePlugin OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2018-10-03 20:00:05,661 INFO  [localhost-startStop-2]  c.a.s.internal.home.HomeLockAcquirer Releasing lock on /var/atlassian/application-data/bitbucket/shared
2018-10-03 20:00:05,666 INFO  [localhost-startStop-2]  c.a.s.internal.home.HomeLockAcquirer Releasing lock on /var/atlassian/application-data/bitbucket

Reply

Suggest an answer

Log in or Sign up to answer
Bitbucket
Bitbucket
TAGS
AUG Leaders

Atlassian Community Events

    See all events