bamboo showing no webpage was found

[Andy Huang]

after a reboot of bamboo virtual machine, when accessing bamboo portal using browser showing "no webpage was found".  both bamboo & postgres service seems to be running:

bamboo 6541 1 6 15:16 ? 00:00:37 /usr/bin/java -Djava.util.logging.config.file=/opt/atlassian/bambo /conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -XX:MaxPermSize=256m -Xms256m -Xmx384m -Djava.endorsed.dirs=/opt/atlassian/bamboo/endorsed -classpath /opt/atlassian/bamboo/bin/bootstrap.jar:/opt/atlassian/bamboo/bin/tomcat-juli.jar -Dcatalina.base=/opt/atlassian/bamboo -Dcatalina.home=/opt/atlassian/bamboo -Djava.io.tmpdir=/opt/atlassian/bamboo/temp org.apache.catalina.startup.Bootstrap start

postgres 6162 1 0 15:16 ? 00:00:00 /usr/bin/postgres -D /var/lib/pgsql/data -p 5432
postgres 6221 6162 0 15:16 ? 00:00:00 postgres: logger process
postgres 6254 6162 0 15:16 ? 00:00:00 postgres: checkpointer process
postgres 6256 6162 0 15:16 ? 00:00:00 postgres: writer process
postgres 6257 6162 0 15:16 ? 00:00:00 postgres: wal writer process
postgres 6258 6162 0 15:16 ? 00:00:00 postgres: autovacuum launcher process
postgres 6259 6162 0 15:16 ? 00:00:00 postgres: stats collector process
root 7175 6647 0 15:27 pts/0 00:00:00 grep --color=auto postgre

when it was working can see some following processes, but don't seem to find them anymore:

postgres 14535 6157 0 11:26 ? 00:00:00 postgres: bamboo bamboo 127.0.0.1(47356) idle
postgres 14613 6157 0 11:27 ? 00:00:00 postgres: bamboo bamboo 127.0.0.1(47360) idle
postgres 14614 6157 0 11:27 ? 00:00:00 postgres: bamboo bamboo 127.0.0.1(47361) idle

did anyone have the same issue before? not sure what caused this, can anyone help, thanks.

[Anik Sengupta]

Hi Andy,

Welcome to Atlassian community

There can be multiple reasons for this error, can you try to replicate this error and during the same time check <bamboo-home>logs>atlassian-bamboo.log file to see what exception is being throw?

Based on the exception we can try to understand the problem and the solution

Quick note did you try to restart the DB service and check if the error goes.

Regards,

Anik Sengupta

**please don't forget to Accept the answer if your query was answered**

[Andy Huang]

Hi Anik, thanks for your response. I checked the log yesterday and following the following, seems related to ActiveMQ, but don't seem to find what caused this. I did reboot the whole vm which should also reboot both db & bamboo, but no luck.

at com.atlassian.bamboo.plugins.git.NativeGitOperationHelper$1.call(NativeGitOperationHelper.java:488)
at com.atlassian.bamboo.plugins.git.NativeGitOperationHelper$1.call(NativeGitOperationHelper.java:479)
at com.atlassian.bamboo.util.CallableResultCache$1.load(CallableResultCache.java:52)
at com.atlassian.bamboo.util.CallableResultCache$1.load(CallableResultCache.java:48)
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3568)
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2350)
at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2313)
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3969)
at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4829)
at com.atlassian.bamboo.collections.AlwaysInvalidatingCacheDecorator.get(AlwaysInvalidatingCacheDecorator.java:81)
at com.atlassian.bamboo.collections.AlwaysInvalidatingCacheDecorator.getUnchecked(AlwaysInvalidatingCacheDecorator.java:135)
... 30 more
2024-02-28 14:22:45,332 INFO [10-BAM::Default Agent::Agent:pool-25-thread-1] [BuildAgentControllerImpl] Agent 131073 checking build queue for executables...
2024-02-28 14:23:06,044 INFO [ActiveMQ ShutdownHook] [BrokerService] Apache ActiveMQ 5.9.0 (bamboo, ID:bamboo.dominionvoting.com-42954-1701718328709-0:1) is shutting down
2024-02-28 14:23:06,177 INFO [localhost-startStop-2] [Dispatchers] Dispatcher org.apache.struts2.dispatcher.Dispatcher destroyed
2024-02-28 14:23:06,198 INFO [localhost-startStop-2] [Dispatchers] Dispatcher org.apache.struts2.dispatcher.Dispatcher destroyed
2024-02-28 14:23:06,219 INFO [localhost-startStop-2] [QuartzScheduler] Scheduler scheduler_$_NON_CLUSTERED paused.
2024-02-28 14:23:07,004 INFO [localhost-startStop-2] [SVNClientManagerFactory] Destroying SVNClientManagerFactories...
2024-02-28 14:23:07,792 INFO [ActiveMQ ShutdownHook] [TransportConnector] Connector tcp://bamboo.dominionvoting.com:54663?wireFormat.maxInactivityDuration=300000 stopped
2024-02-28 14:23:07,799 INFO [localhost-startStop-2] [PooledConnection] failed to delete Temporary Queue "temp-queue://ID:bamboo.dominionvoting.com-42954-1701718328709-3:1:6" on closing pooled connection: peer (vm://bamboo#1) stopped.
2024-02-28 14:23:07,799 WARN [localhost-startStop-2] [DisposableBeanAdapter] Invocation of destroy method failed on bean with name 'bandanaManagerService': javax.jms.JMSException: Peer (vm://bamboo#1) disposed.
2024-02-28 14:23:07,799 WARN [localhost-startStop-2] [DisposableBeanAdapter] Invocation of destroy method failed on bean with name 'capabilityManagerService': javax.jms.JMSException: Peer (vm://bamboo#1) disposed.
2024-02-28 14:23:07,799 WARN [localhost-startStop-2] [DisposableBeanAdapter] Invocation of destroy method failed on bean with name 'agentQueueAccessorService': javax.jms.JMSException: Peer (vm://bamboo#1) disposed.
2024-02-28 14:23:07,799 WARN [localhost-startStop-2] [DisposableBeanAdapter] Invocation of destroy method failed on bean with name 'remoteAgentAdministrationConfigurationAccessorService': javax.jms.JMSException: Peer (vm://bamboo#1) disposed.
2024-02-28 14:23:07,799 WARN [localhost-startStop-2] [DisposableBeanAdapter] Invocation of destroy method failed on bean with name 'remoteAgentManagerService': javax.jms.JMSException: Peer (vm://bamboo#1) disposed.
2024-02-28 14:23:07,814 INFO [ActiveMQ ShutdownHook] [TransportConnector] Connector vm://bamboo stopped
2024-02-28 14:23:07,816 INFO [ActiveMQ Connection Executor: vm://bamboo#0] [PooledConnectionFactory] Expiring connection ActiveMQConnection {id=ID:bamboo.dominionvoting.com-42954-1701718328709-3:1,clientId=ID:bamboo.dominionvoting.com-42954-1701718328709-2:1,started=false} on IOException: org.apache.activemq.transport.TransportDisposedIOException: peer (vm://bamboo#1) stopped.
2024-02-28 14:23:07,816 INFO [localhost-startStop-2] [ShutdownEnforcer] Container being shut down: starting last-resort termination thread.
2024-02-28 14:23:07,819 INFO [localhost-startStop-2] [AgentManagerImpl] Stopping all local agents...
2024-02-28 14:23:07,819 WARN [10-BAM::Default Agent::Agent:pool-25-thread-1] [BuildAgentControllerImpl] Building interrupted. Stopping agent 'Default Agent'...
2024-02-28 14:23:07,819 INFO [10-BAM::Default Agent::Agent:pool-25-thread-1] [DefaultBuildAgent] Changing context: null -> null on Default Agent/23211f71
2024-02-28 14:23:07,819 INFO [10-BAM::Default Agent::Agent:pool-25-thread-1] [DefaultBuildAgent] Build agent 'Default Agent' stopped.
2024-02-28 14:23:07,823 INFO [ActiveMQ ShutdownHook] [PListStoreImpl] PListStore:[/home/bamboo/bamboo-home/jms-store/bamboo/tmp_storage] stopped
2024-02-28 14:23:07,824 INFO [ActiveMQ ShutdownHook] [KahaDBStore] Stopping async queue tasks
2024-02-28 14:23:07,824 INFO [ActiveMQ ShutdownHook] [KahaDBStore] Stopping async topic tasks
2024-02-28 14:23:07,824 INFO [ActiveMQ ShutdownHook] [KahaDBStore] Stopped KahaDB
2024-02-28 14:23:07,831 INFO [localhost-startStop-2] [QuartzScheduler] Scheduler scheduler_$_NON_CLUSTERED shutting down.
2024-02-28 14:23:07,832 INFO [localhost-startStop-2] [QuartzScheduler] Scheduler scheduler_$_NON_CLUSTERED paused.
2024-02-28 14:23:07,837 INFO [localhost-startStop-2] [QuartzScheduler] Scheduler scheduler_$_NON_CLUSTERED shutdown complete.
2024-02-28 14:23:07,840 INFO [localhost-startStop-2] [ConfigurableLocalSessionFactoryBean] Closing Hibernate SessionFactory
2024-02-28 14:23:07,864 INFO [localhost-startStop-2] [BambooPluginManager] Plugin state will no longer be persisted.

[Anik Sengupta]

Hi  Andy,

I see that the error string itself has been truncated. Can you send us the complete error snippet.

Also the below logs which you see are after Bamboo is shutting down

2024-02-28 14:22:45,332 INFO [10-BAM::Default Agent::Agent:pool-25-thread-1] [BuildAgentControllerImpl] Agent 131073 checking build queue for executables...
2024-02-28 14:23:06,044 INFO [ActiveMQ ShutdownHook] [BrokerService] Apache ActiveMQ 5.9.0 (bamboo, ID:bamboo.dominionvoting.com-42954-1701718328709-0:1) is shutting down

Regards,

Anik Sengupta

**please don't forget to Accept the answer if your query was answered**

[Andy Huang]

I have downloaded the whole atlassian-bamboo.log file, and zipped to 238KB, anywhere I can upload it? Thanks.

[Anik Sengupta]

Instead of uploading the complete file, can you paste the complete error snippet 

[Andy Huang]

Hi Anik, unfortunately I don't know what specific I have to look for that's why I am trying to upload the whole log file. If that can't be done, any key word I should use to search for in the log file? Thanks.

[Andy Huang]

Hi Anik, can you advise where the truncated error is in the log file, I can try to find the complete error snippet, thanks.

[Jyothi Charupalli]

Hi Andy,

Can you please provide the error screenshot you are getting while accessing Bamboo UI?

Do you have any proxy setup before Bamboo server? If yes, could you please check if it is updated in <Bamboo-Install-Directory>/conf/server.xml.

Do you see any errors in the <Bamboo-Install-Directory>/logs/catalina.out file when accessing the Bamboo UI?

Is your Bamboo server reachable from the internet, do you have any DNS configuration for Bamboo server before the virtual machine reboot in the/etc/hosts file?

We might need a complete Bamboo support zip which will help us to check the complete server logs. If in case we are not able to get any clue from the above mentioned details, we suggest you raise a support ticket to our Bamboo support team to further investigate the issue.

Regards,

Jyothi Charupalli

[Andy Huang]

Hi Jyothi, please see attached screenshot. I don't see proxy config in <Bamboo-Install-Directory>/conf/server.xml. I don't see any lines added to <Bamboo-Install-Directory>/logs/catalina.out file when access bamboo UI. The bamboo server isn't reachable from the internet. Currently there are only 2 localhost lines, there is no DNS config in /etc/hosts file. How do I generate a complete bamboo support zip? Thanks.

[Jyothi Charupalli]

Hi Andy,

Thanks for the response. 

To check the issue further, you can do the following and provide the output:

1. Test connection to Bamboo: telnet bamboo.dominionvoting.com 8085

2. ping bamboo.dominionvoting.com

3. Check the Java path defined on Bamboo server: echo $JAVA_HOME

As Bamboo is down now you can't create a support zip currently but for your reference in future on how to create a support zip.

To create a support request to Atlassian Support:https://support.atlassian.com/contact/#/

Best Regards,

Jyothi

[Andy Huang]

Hi Jyothi,

     Appreciate your help. I test telnet, ping both work. output of echo $JAVA_HOME is /usr/java/latest. Is self-hosted bamboo support still available? I thought it's ended since Feb. 15, 2024?

[Jyothi Charupalli]

Hi Andy,

Yes, for Bamboo server products, support ended on FEB 15th 2024. In order to get assistance from the Atlassian support team, you need to get a Datacenter license.  Please refer https://www.atlassian.com/software/bamboo/download. 

echo $JAVA_HOME is /usr/java/latest 

Can you please check if this is the correct Java home path pointing to your Java JDK path? 

Please confirm your Bamboo version and Java version on the server.

Regards,

Jyothi

[Andy Huang]

Hi Jyothi,

Following is my findings:

*. output of echo $JAVA_HOME is /usr/java/latest

*. bamboo install folder: /opt/atlassian/atlassian-bamboo-5.7.2/, assume bamboo version is 5.7.2

*. java version "1.8.0_191"
Java(TM) SE Runtime Environment (build 1.8.0_191-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode)