Forums

Articles
Create
cancel
Showing results for 
Search instead for 
Did you mean: 

Upgrade from 7.4.4 to 7.14.1, entire instance reset to default?

Deleted user November 1, 2021

I want to preface this with I was not the person that this server up, I am just maintaining it now.

 

Not sure if this is expected behavior or not, but I recently upgraded my confluence instance due to CVE-2021-42574. I downloaded the .bin file and ran it on my Debian 11 server, and it finished no problem.

I go to log back in, and its not even listening on 8443 (what was setup before).

I  go to the HTTP (8080) URL and try to login, but when I press enter, it just reloads the login page. No incorrect username or password, just reloads the same page without error.

I didn't see an attach file option here, so I have put the catalina.out and http access log at the bottom.

 

It appears that the confluence server has been reset to default.

Is this expected behavior for an upgrade using the installer?

I saw it made a bunch of backups during the upgrade process, so I suppose I can take comfort in that.

Can anyone point me to the documentation for restoring those backups if this is not normal?

 

 

Specs:

Debian 11

openjdk version "11.0.13" 2021-10-19
OpenJDK Runtime Environment (build 11.0.13+8-post-Debian-1deb11u1)
OpenJDK 64-Bit Server VM (build 11.0.13+8-post-Debian-1deb11u1, mixed mode, sharing)

Redis server v=6.0.15 sha=00000000:0 malloc=jemalloc-5.2.1 bits=64 build=4610f4c3acf7fb25

It appears I have two versions of postgres running (although the server is still broken with one or the other service stopped):

postgresql@14-main.service  and  postgresql@11-main.service

postgres (PostgreSQL) 11.13 (Debian 11.13-1.pgdg100+1)
postgres (PostgreSQL) 14.0 (Debian 14.0-1.pgdg100+1)


[01/Nov/2021:19:28:10 -0400] - http-nio-8080-exec-2 CLIENTIP GET /rest/quickreload/latest/0?since=1635809200251 HTTP/1.1 200 9ms 118 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0
[01/Nov/2021:19:28:39 -0400] - http-nio-8080-exec-1 CLIENTIP GET /rest/quickreload/latest/0?since=1635809290263 HTTP/1.1 200 9ms 118 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0
[01/Nov/2021:19:28:40 -0400] - http-nio-8080-exec-9 CLIENTIP GET /login.action?os_destination=%2Findex.action&permissionViolation=true HTTP/1.1 200 213ms 6967 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0
[01/Nov/2021:19:28:40 -0400] - http-nio-8080-exec-5 CLIENTIP GET /s/a97f7263f8f209a3475d42d83d19caa7-CDN/331dsu/8803/xi7l17/1cddd89b1a42cebd26452214f00d3af5/_/download/contextbatch/js/main,-_super/batch.js?locale=en-US HTTP/1.1 200 7ms 3642 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0
[01/Nov/2021:19:28:40 -0400] - http-nio-8080-exec-4 CLIENTIP GET /s/022cc09f6d899267c9a42e542260a917-CDN/331dsu/8803/xi7l17/1.0/_/download/batch/confluence.web.resources:login/confluence.web.resources:login.js?locale=en-US HTTP/1.1 200 15ms 869 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0
[01/Nov/2021:19:28:40 -0400] - http-nio-8080-exec-3 CLIENTIP GET /s/5c80164cdd03e853538c996aeb0399b8-CDN/331dsu/8803/xi7l17/430e0b4e03c8e6bf7f9317c92d1bf0ab/_/download/contextbatch/js/atl.general,-_super/batch.js?locale=en-US HTTP/1.1 200 28ms 51932 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0
[01/Nov/2021:19:28:40 -0400] - http-nio-8080-exec-8 CLIENTIP GET /s/8e405ee20449cfed925b5ea254dcdb08-CDN/331dsu/8803/xi7l17/ce7ceb36fb0bf486e5401fd04868e8d1/_/download/contextbatch/js/_super/batch.js?locale=en-US HTTP/1.1 200 71ms 269537 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0
[01/Nov/2021:19:28:40 -0400] - http-nio-8080-exec-6 CLIENTIP GET /rest/shortcuts/latest/shortcuts/8803/941ae4c877565cdf8024f4bb9ed42066 HTTP/1.1 200 8ms 1591 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0
[01/Nov/2021:19:28:41 -0400] - http-nio-8080-exec-7 CLIENTIP POST /rest/analytics/1.0/publish/bulk HTTP/1.1 200 11ms 40 http://SERVERIP:8080/login.action?os_destination=%2Findex.action&permissionViolation=true Mozilla/5.0 (Windows NT 10.0; rv:91.0) Gecko/20100101 Firefox/91.0

 


NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
[0.000s][warning][gc] -Xloggc is deprecated. Will use -Xlog:gc:/opt/atlassian/confluence/logs/gc-2021-11-01_18-46-40.log instead.
01-Nov-2021 18:46:40.392 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server] failed to set property [debug] to [0]
01-Nov-2021 18:46:40.463 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Connector] failed to set property [debug] to [0]
01-Nov-2021 18:46:40.481 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine] failed to set property [debug] to [0]
01-Nov-2021 18:46:40.486 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host] failed to set property [debug] to [0]
01-Nov-2021 18:46:40.523 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host/Context] failed to set property [debug] to [0]
01-Nov-2021 18:46:40.549 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host/Context] failed to set property [debug] to [0]
01-Nov-2021 18:46:40.889 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
01-Nov-2021 18:46:40.919 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [603] milliseconds
01-Nov-2021 18:46:40.926 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Tomcat-Standalone]
01-Nov-2021 18:46:40.926 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.54]
01-Nov-2021 18:46:42.285 INFO [Catalina-utility-2] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
01-Nov-2021 18:46:42.492 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log 1 Spring WebApplicationInitializers detected on classpath
log4j:ERROR Could not find value for key log4j.appender.luceneQuery
log4j:ERROR Could not instantiate appender named "luceneQuery".
01-Nov-2021 18:46:42.685 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log Initializing Spring DispatcherServlet 'dispatcher'
18:46:42 [Catalina-utility-2] o.a.c.c.C.[.[.[/synchrony-proxy][INFO] log - Initializing Spring DispatcherServlet 'dispatcher'
2021-11-01 18:46:43,213 INFO [Catalina-utility-1] [com.atlassian.confluence.lifecycle] contextInitialized Starting Confluence 7.14.1 [build 8803 based on commit hash 97a9d1e684b7cce06f5d1c8b70161ee2686c3de8] - synchrony version 4.0.0-master-f680ea21
2021-11-01 18:46:46,027 WARN [Catalina-utility-1] [confluence.impl.setup.DefaultBootstrapDatabaseAccessor] lambda$getBootstrapData$0 Unable to determine ZDU status from database [message: ERROR: relation "confzdu" does not exist
Position: 29]. If you are upgrading from a Confluence version prior to 7.9, this is expected.
2021-11-01 18:46:46,033 WARN [Catalina-utility-1] [confluence.impl.setup.DefaultBootstrapDatabaseAccessor] lambda$getBootstrapData$3 Unable to determine finalized build number from database [message: ERROR: column "finalized" does not exist
Position: 48]. If you are upgrading from a Confluence version prior to 7.14, this is expected.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/opt/atlassian/confluence/confluence/WEB-INF/lib/org.apache.felix.framework-5.6.12.jar) to method java.net.URLClassLoader.addURL(java.net.URL)
WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Security framework of XStream not explicitly initialized, using predefined black list on your own risk.
01-Nov-2021 18:49:09.482 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
01-Nov-2021 18:49:09.497 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [148577] milliseconds
01-Nov-2021 18:52:02.719 INFO [Thread-34] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-8080"]
01-Nov-2021 18:52:02.731 INFO [Thread-34] org.apache.catalina.core.StandardService.stopInternal Stopping service [Tomcat-Standalone]
01-Nov-2021 18:52:02.735 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log Destroying Spring FrameworkServlet 'dispatcher'
18:52:02 [Catalina-utility-2] o.a.c.c.C.[.[.[/synchrony-proxy][INFO] log - Destroying Spring FrameworkServlet 'dispatcher'
NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
[0.000s][warning][gc] -Xloggc is deprecated. Will use -Xlog:gc:/opt/atlassian/confluence/logs/gc-2021-11-01_18-53-49.log instead.
01-Nov-2021 18:53:50.141 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server] failed to set property [debug] to [0]
01-Nov-2021 18:53:50.205 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Connector] failed to set property [debug] to [0]
01-Nov-2021 18:53:50.222 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine] failed to set property [debug] to [0]
01-Nov-2021 18:53:50.227 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host] failed to set property [debug] to [0]
01-Nov-2021 18:53:50.267 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host/Context] failed to set property [debug] to [0]
01-Nov-2021 18:53:50.295 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host/Context] failed to set property [debug] to [0]
01-Nov-2021 18:53:50.642 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
01-Nov-2021 18:53:50.670 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [636] milliseconds
01-Nov-2021 18:53:50.677 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Tomcat-Standalone]
01-Nov-2021 18:53:50.677 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.54]
01-Nov-2021 18:53:52.135 INFO [Catalina-utility-2] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
01-Nov-2021 18:53:52.354 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log 1 Spring WebApplicationInitializers detected on classpath
log4j:ERROR Could not find value for key log4j.appender.luceneQuery
log4j:ERROR Could not instantiate appender named "luceneQuery".
01-Nov-2021 18:53:52.563 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log Initializing Spring DispatcherServlet 'dispatcher'
18:53:52 [Catalina-utility-2] o.a.c.c.C.[.[.[/synchrony-proxy][INFO] log - Initializing Spring DispatcherServlet 'dispatcher'
2021-11-01 18:53:53,267 INFO [Catalina-utility-1] [com.atlassian.confluence.lifecycle] contextInitialized Starting Confluence 7.14.1 [build 8803 based on commit hash 97a9d1e684b7cce06f5d1c8b70161ee2686c3de8] - synchrony version 4.0.0-master-f680ea21
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/opt/atlassian/confluence/confluence/WEB-INF/lib/org.apache.felix.framework-5.6.12.jar) to method java.net.URLClassLoader.addURL(java.net.URL)
WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Security framework of XStream not explicitly initialized, using predefined black list on your own risk.
01-Nov-2021 18:54:58.226 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
01-Nov-2021 18:54:58.258 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [68081] milliseconds
01-Nov-2021 18:57:54.427 INFO [http-nio-8080-exec-1] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
01-Nov-2021 18:58:41.671 INFO [http-nio-8080-exec-5] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
01-Nov-2021 19:10:59.624 INFO [http-nio-8080-exec-6] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
01-Nov-2021 19:14:17.055 INFO [main] org.apache.catalina.core.StandardServer.await A valid shutdown command was received via the shutdown port. Stopping the Server instance.
01-Nov-2021 19:14:17.056 INFO [main] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-8080"]
01-Nov-2021 19:14:17.062 INFO [main] org.apache.catalina.core.StandardService.stopInternal Stopping service [Tomcat-Standalone]
01-Nov-2021 19:14:17.065 INFO [Catalina-utility-4] org.apache.catalina.core.ApplicationContext.log Destroying Spring FrameworkServlet 'dispatcher'
19:14:17 [Catalina-utility-4] o.a.c.c.C.[.[.[/synchrony-proxy][INFO] log - Destroying Spring FrameworkServlet 'dispatcher'
WARNING: Cannot update an inactive framework.
01-Nov-2021 19:14:22.916 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [ROOT] registered the JDBC driver [org.postgresql.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
01-Nov-2021 19:14:22.917 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [ROOT] registered the JDBC driver [com.github.gquintana.metrics.sql.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
01-Nov-2021 19:14:22.917 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [ROOT] registered the JDBC driver [com.microsoft.sqlserver.jdbc.SQLServerDriver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
01-Nov-2021 19:14:22.917 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [ROOT] registered the JDBC driver [net.sourceforge.jtds.jdbc.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
01-Nov-2021 19:14:22.917 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [ROOT] registered the JDBC driver [org.h2.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
01-Nov-2021 19:14:22.917 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [ROOT] registered the JDBC driver [org.hsqldb.jdbc.JDBCDriver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
01-Nov-2021 19:14:22.920 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [scheduler_Worker-1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/java.lang.Object.wait(Native Method)
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
01-Nov-2021 19:14:22.921 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [scheduler_Worker-2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/java.lang.Object.wait(Native Method)
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
01-Nov-2021 19:14:22.921 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [scheduler_Worker-3] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/java.lang.Object.wait(Native Method)
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
01-Nov-2021 19:14:22.922 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [scheduler_Worker-7] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/java.lang.Object.wait(Native Method)
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
01-Nov-2021 19:14:22.923 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [scheduler_Worker-8] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/java.lang.Object.wait(Native Method)
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
01-Nov-2021 19:14:22.924 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [scheduler_Worker-9] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/java.lang.Object.wait(Native Method)
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
01-Nov-2021 19:14:22.925 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [scheduler_Worker-10] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/java.lang.Object.wait(Native Method)
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
01-Nov-2021 19:14:22.926 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [AtlassianEvent::CustomizableThreadFactory-1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(Unknown Source)
java.base@11.0.12/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
java.base@11.0.12/java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base@11.0.12/java.lang.Thread.run(Unknown Source)
01-Nov-2021 19:14:22.927 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [AtlassianEvent::CustomizableThreadFactory-2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(Unknown Source)
java.base@11.0.12/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
java.base@11.0.12/java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base@11.0.12/java.lang.Thread.run(Unknown Source)
01-Nov-2021 19:14:22.927 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [atlassian-webhooks-scheduler:thread-1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.12/java.util.concurrent.locks.LockSupport.parkNanos(Unknown Source)
java.base@11.0.12/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Unknown Source)
java.base@11.0.12/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
java.base@11.0.12/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base@11.0.12/java.lang.Thread.run(Unknown Source)
01-Nov-2021 19:14:22.928 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [atlassian-instrumentation-jmx:thread-1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.12/java.util.concurrent.locks.LockSupport.parkNanos(Unknown Source)
java.base@11.0.12/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Unknown Source)
java.base@11.0.12/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
java.base@11.0.12/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base@11.0.12/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base@11.0.12/java.lang.Thread.run(Unknown Source)
01-Nov-2021 19:14:22.930 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [Caesium-1-1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(Unknown Source)
java.base@11.0.12/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
com.atlassian.scheduler.caesium.impl.SchedulerQueueImpl.takeUnderLock(SchedulerQueueImpl.java:292)
com.atlassian.scheduler.caesium.impl.SchedulerQueueImpl.take(SchedulerQueueImpl.java:246)
com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.executeNextJob(SchedulerQueueWorker.java:54)
com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.run(SchedulerQueueWorker.java:35)
java.base@11.0.12/java.lang.Thread.run(Unknown Source)
01-Nov-2021 19:14:22.931 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [Caesium-1-2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(Unknown Source)
java.base@11.0.12/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
com.atlassian.scheduler.caesium.impl.SchedulerQueueImpl.takeUnderLock(SchedulerQueueImpl.java:292)
com.atlassian.scheduler.caesium.impl.SchedulerQueueImpl.take(SchedulerQueueImpl.java:246)
com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.executeNextJob(SchedulerQueueWorker.java:54)
com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.run(SchedulerQueueWorker.java:35)
java.base@11.0.12/java.lang.Thread.run(Unknown Source)
01-Nov-2021 19:14:22.932 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [Caesium-1-3] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(Unknown Source)
java.base@11.0.12/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
com.atlassian.scheduler.caesium.impl.SchedulerQueueImpl.takeUnderLock(SchedulerQueueImpl.java:292)
com.atlassian.scheduler.caesium.impl.SchedulerQueueImpl.take(SchedulerQueueImpl.java:246)
com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.executeNextJob(SchedulerQueueWorker.java:54)
com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.run(SchedulerQueueWorker.java:35)
java.base@11.0.12/java.lang.Thread.run(Unknown Source)
01-Nov-2021 19:14:22.933 WARNING [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [Caesium-1-4] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(Unknown Source)
java.base@11.0.12/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
com.atlassian.scheduler.caesium.impl.SchedulerQueueImpl.takeUnderLock(SchedulerQueueImpl.java:292)
com.atlassian.scheduler.caesium.impl.SchedulerQueueImpl.take(SchedulerQueueImpl.java:246)
com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.executeNextJob(SchedulerQueueWorker.java:54)
com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.run(SchedulerQueueWorker.java:35)
java.base@11.0.12/java.lang.Thread.run(Unknown Source)
01-Nov-2021 19:14:22.936 SEVERE [Catalina-utility-3] org.apache.catalina.loader.WebappClassLoaderBase.checkThreadLocalMapForLeaks The web application [ROOT] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@4262d2bf]) and a value of type [brave.Tracer.SpanInScope] (value [brave.propagation.ThreadLocalCurrentTraceContext$RevertToNullScope@7f2248bc]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
01-Nov-2021 19:14:22.951 INFO [main] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["http-nio-8080"]
01-Nov-2021 19:14:22.992 INFO [main] org.apache.coyote.AbstractProtocol.destroy Destroying ProtocolHandler ["http-nio-8080"]
NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
[0.000s][warning][gc] -Xloggc is deprecated. Will use -Xlog:gc:/opt/atlassian/confluence/logs/gc-2021-11-01_19-14-23.log instead.
01-Nov-2021 19:14:23.925 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server] failed to set property [debug] to [0]
01-Nov-2021 19:14:23.986 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Connector] failed to set property [debug] to [0]
01-Nov-2021 19:14:24.005 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine] failed to set property [debug] to [0]
01-Nov-2021 19:14:24.010 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host] failed to set property [debug] to [0]
01-Nov-2021 19:14:24.050 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host/Context] failed to set property [debug] to [0]
01-Nov-2021 19:14:24.080 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host/Context] failed to set property [debug] to [0]
01-Nov-2021 19:14:24.421 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
01-Nov-2021 19:14:24.447 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [624] milliseconds
01-Nov-2021 19:14:24.453 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Tomcat-Standalone]
01-Nov-2021 19:14:24.453 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.54]
01-Nov-2021 19:14:25.876 INFO [Catalina-utility-2] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
01-Nov-2021 19:14:26.095 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log 1 Spring WebApplicationInitializers detected on classpath
log4j:ERROR Could not find value for key log4j.appender.luceneQuery
log4j:ERROR Could not instantiate appender named "luceneQuery".
01-Nov-2021 19:14:26.318 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log Initializing Spring DispatcherServlet 'dispatcher'
19:14:26 [Catalina-utility-2] o.a.c.c.C.[.[.[/synchrony-proxy][INFO] log - Initializing Spring DispatcherServlet 'dispatcher'
2021-11-01 19:14:26,782 INFO [Catalina-utility-1] [com.atlassian.confluence.lifecycle] contextInitialized Starting Confluence 7.14.1 [build 8803 based on commit hash 97a9d1e684b7cce06f5d1c8b70161ee2686c3de8] - synchrony version 4.0.0-master-f680ea21
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/opt/atlassian/confluence/confluence/WEB-INF/lib/org.apache.felix.framework-5.6.12.jar) to method java.net.URLClassLoader.addURL(java.net.URL)
WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Security framework of XStream not explicitly initialized, using predefined black list on your own risk.
01-Nov-2021 19:15:29.463 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
01-Nov-2021 19:15:29.503 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [65055] milliseconds
01-Nov-2021 19:15:30.328 INFO [http-nio-8080-exec-1] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
01-Nov-2021 19:15:40.871 INFO [http-nio-8080-exec-8] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
01-Nov-2021 19:15:41.998 INFO [http-nio-8080-exec-9] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
01-Nov-2021 19:18:29.113 INFO [main] org.apache.catalina.core.StandardServer.await A valid shutdown command was received via the shutdown port. Stopping the Server instance.
01-Nov-2021 19:18:29.113 INFO [main] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-8080"]
01-Nov-2021 19:18:29.119 INFO [main] org.apache.catalina.core.StandardService.stopInternal Stopping service [Tomcat-Standalone]
01-Nov-2021 19:18:29.121 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log Destroying Spring FrameworkServlet 'dispatcher'
19:18:29 [Catalina-utility-2] o.a.c.c.C.[.[.[/synchrony-proxy][INFO] log - Destroying Spring FrameworkServlet 'dispatcher'
2021-11-01 19:18:49
Full thread dump OpenJDK 64-Bit Server VM (11.0.12+7 mixed mode):

Threads class SMR info:
_java_thread_list=0x00007f5f480e5320, length=146, elements={
0x00007f5f8402a800, 0x00007f5f84400800, 0x00007f5f84403000, 0x00007f5f84418000,
0x00007f5f8441a000, 0x00007f5f8441c000, 0x00007f5f84420800, 0x00007f5f84422000,
0x00007f5f844a9000, 0x00007f5f84510000, 0x00007f5f84555800, 0x00007f5f849bd000,
0x00007f5f849be000, 0x00007f5f16191000, 0x00007f5f1627c800, 0x00007f5f163d3800,
0x00007f5f163d7000, 0x00007f5f163d9000, 0x00007f5f163da800, 0x00007f5f163dc800,
0x00007f5f163de000, 0x00007f5f163e0000, 0x00007f5f163e2800, 0x00007f5f163ef000,
0x00007f5f163f0800, 0x00007f5f163f4800, 0x00007f5f16427800, 0x00007f5f162fa000,
0x00007f5f16a6e000, 0x00007f5f16da9800, 0x00007f5f16db0800, 0x00007f5f16db2000,
0x00007f5f16db4800, 0x00007f5f16db7000, 0x00007f5f16dcb000, 0x00007f5f16ddf000,
0x00007f5f16de0800, 0x00007f5f16ded000, 0x00007f5f34003800, 0x00007f5f34005800,
0x00007f5f38609800, 0x00007f5f16dee800, 0x00007f5f30001800, 0x00007f5f3c704000,
0x00007f5ee4005800, 0x00007f5ee4002000, 0x00007f5ee40ea800, 0x00007f5f04262000,
0x00007f5f04265800, 0x00007f5f17baa000, 0x00007f5f17405800, 0x00007f5efc19e000,
0x00007f5f0c052800, 0x00007f5f0c01a800, 0x00007f5f0c016000, 0x00007f5f0c050000,
0x00007f5f0c085800, 0x00007f5f0c087000, 0x00007f5f0c089000, 0x00007f5f0c08b000,
0x00007f5f0c08d000, 0x00007f5f0c08f000, 0x00007f5ef4072000, 0x00007f5ef4077800,
0x00007f5f1535c000, 0x00007f5f1535d000, 0x00007f5f544c9000, 0x00007f5f518a3800,
0x00007f5f518c6800, 0x00007f5f642ac000, 0x00007f5ef013d800, 0x00007f5f081b2800,
0x00007f5f4015c000, 0x00007f5ee424e000, 0x00007f5ee42a7800, 0x00007f5ee42aa800,
0x00007f5ee42ac000, 0x00007f5ee42ae000, 0x00007f5ee42b0000, 0x00007f5ee42b2000,
0x00007f5ee42b4000, 0x00007f5ee42b6000, 0x00007f5ee42b8800, 0x00007f5f681ee000,
0x00007f5f081c6000, 0x00007f5f681e2800, 0x00007f5ee4377800, 0x00007f5f3909e000,
0x00007f5f68289000, 0x00007f5f38947000, 0x00007f5f1743d000, 0x00007f5f1760a800,
0x00007f5f1768e000, 0x00007f5f401c2000, 0x00007f5f401c4000, 0x00007f5f04239000,
0x00007f5edc093800, 0x00007f5edc097000, 0x00007f5edc098800, 0x00007f5edc09a000,
0x00007f5edc0c9800, 0x00007f5f84c4a000, 0x00007f5f18677800, 0x00007f5f8495c800,
0x00007f5f84437000, 0x000055b76229d800, 0x000055b7622a0000, 0x00007f5ef01c9000,
0x00007f5eec4b1800, 0x000055b7622a1000, 0x000055b762274800, 0x000055b762276800,
0x000055b762278000, 0x00007f5f40160800, 0x000055b762279800, 0x00007f5f4c917000,
0x000055b76227b000, 0x000055b76227c800, 0x00007f5f40162800, 0x000055b76227d800,
0x00007f5f64e3c800, 0x00007f5f18678800, 0x00007f5f4c91b000, 0x00007f5f30009000,
0x00007f5f4014e000, 0x00007f5f51a06000, 0x00007f5f1866c000, 0x000055b7622f0800,
0x00007f5f55ceb800, 0x00007f5f548d2800, 0x00007f5f5402e800, 0x00007f5f54798800,
0x00007f5f546df000, 0x00007f5f5581e000, 0x00007f5f5581f000, 0x00007f5f55820000,
0x00007f5f55821000, 0x00007f5f55822800, 0x00007f5f55823800, 0x00007f5f55824800,
0x00007f5f55825800, 0x00007f5f55827000, 0x00007f5f55828800, 0x00007f5f55829800,
0x00007f5f50002000, 0x00007f5f84924800
}

"main" #1 prio=5 os_prio=0 cpu=904.81ms elapsed=265.60s tid=0x00007f5f8402a800 nid=0xea9 waiting on condition [0x00007f5f89862000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.12/Native Method)
- parking to wait for <0x00000000fa9b3de0> (a java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.12/Unknown Source)
at java.util.concurrent.FutureTask.awaitDone(java.base@11.0.12/Unknown Source)
at java.util.concurrent.FutureTask.get(java.base@11.0.12/Unknown Source)
at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:992)
- locked <0x00000000c01282f8> (a org.apache.catalina.core.StandardHost)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
- locked <0x00000000c01282f8> (a org.apache.catalina.core.StandardHost)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1412)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1401)
at java.util.concurrent.FutureTask.run(java.base@11.0.12/Unknown Source)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(java.base@11.0.12/Unknown Source)
at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:986)
- locked <0x00000000c0128728> (a org.apache.catalina.core.StandardEngine)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
- locked <0x00000000c0128728> (a org.apache.catalina.core.StandardEngine)
at org.apache.catalina.core.StandardService.stopInternal(StandardService.java:497)
- locked <0x00000000c0128728> (a org.apache.catalina.core.StandardEngine)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
- locked <0x00000000c07a2ad8> (a org.apache.catalina.core.StandardService)
at org.apache.catalina.core.StandardServer.stopInternal(StandardServer.java:979)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
- locked <0x00000000c0127e98> (a org.apache.catalina.core.StandardServer)
at org.apache.catalina.startup.Catalina.stop(Catalina.java:849)
at org.apache.catalina.startup.Catalina.start(Catalina.java:811)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@11.0.12/Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@11.0.12/Unknown Source)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.12/Unknown Source)
at java.lang.reflect.Method.invoke(java.base@11.0.12/Unknown Source)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)

"Reference Handler" #2 daemon prio=10 os_prio=0 cpu=14.17ms elapsed=265.58s tid=0x00007f5f84400800 nid=0xeb0 waiting on condition [0x00007f5f5d41c000]
java.lang.Thread.State: RUNNABLE
at java.lang.ref.Reference.waitForReferencePendingList(java.base@11.0.12/Native Method)
at java.lang.ref.Reference.processPendingReferences(java.base@11.0.12/Unknown Source)
at java.lang.ref.Reference$ReferenceHandler.run(java.base@11.0.12/Unknown Source)

NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
[0.000s][warning][gc] -Xloggc is deprecated. Will use -Xlog:gc:/opt/atlassian/confluence/logs/gc-2021-11-01_19-19-06.log instead.
01-Nov-2021 19:19:07.217 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server] failed to set property [debug] to [0]
01-Nov-2021 19:19:07.292 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Connector] failed to set property [debug] to [0]
01-Nov-2021 19:19:07.311 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine] failed to set property [debug] to [0]
01-Nov-2021 19:19:07.316 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host] failed to set property [debug] to [0]
01-Nov-2021 19:19:07.352 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host/Context] failed to set property [debug] to [0]
01-Nov-2021 19:19:07.384 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match [Server/Service/Engine/Host/Context] failed to set property [debug] to [0]
01-Nov-2021 19:19:07.735 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
01-Nov-2021 19:19:07.768 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [635] milliseconds
01-Nov-2021 19:19:07.776 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Tomcat-Standalone]
01-Nov-2021 19:19:07.777 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.54]
01-Nov-2021 19:19:09.250 INFO [Catalina-utility-2] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
01-Nov-2021 19:19:09.466 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log 1 Spring WebApplicationInitializers detected on classpath
log4j:ERROR Could not find value for key log4j.appender.luceneQuery
log4j:ERROR Could not instantiate appender named "luceneQuery".
01-Nov-2021 19:19:09.681 INFO [Catalina-utility-2] org.apache.catalina.core.ApplicationContext.log Initializing Spring DispatcherServlet 'dispatcher'
19:19:09 [Catalina-utility-2] o.a.c.c.C.[.[.[/synchrony-proxy][INFO] log - Initializing Spring DispatcherServlet 'dispatcher'
2021-11-01 19:19:10,421 INFO [Catalina-utility-1] [com.atlassian.confluence.lifecycle] contextInitialized Starting Confluence 7.14.1 [build 8803 based on commit hash 97a9d1e684b7cce06f5d1c8b70161ee2686c3de8] - synchrony version 4.0.0-master-f680ea21
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/opt/atlassian/confluence/confluence/WEB-INF/lib/org.apache.felix.framework-5.6.12.jar) to method java.net.URLClassLoader.addURL(java.net.URL)
WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Security framework of XStream not explicitly initialized, using predefined black list on your own risk.
01-Nov-2021 19:20:13.948 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
01-Nov-2021 19:20:13.983 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [66214] milliseconds
01-Nov-2021 19:20:15.049 INFO [http-nio-8080-exec-1] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
01-Nov-2021 19:24:34.937 INFO [http-nio-8080-exec-4] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
01-Nov-2021 19:24:35.951 INFO [http-nio-8080-exec-5] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'

3 answers

0 votes
Deleted user November 3, 2021

I ran the upgrade installer again, and suddenly I am able to login.

I'm guessing the installation just broke the first time around.

 

I am still very unhappy with this process. I refuse to continue to use an application as "polished" as confluence and have to go through such a manual upgrade process, and have it just break the web interface.

0 votes
Deleted user November 2, 2021

Well, the restore didn't exactly work and I screwed up. I checked out the modifications.txt file that was in /opt/atlassian

Had two web.xmls listed. I went ahead and moved over the backup web.xmls to the existing directory, restarted confluence and now the web server doesnt work at all. Got refused to connect on port 8080 (netcat to port shows its open).

Also, made a big mistake. I copied the backup zip file from /var/atlassian/application-data/date-confluence-7.4.4-back.zip to the directory where I was extracting everything and forgot I already had the /opt/atlassian/date-confluence-7.4.4-back.zip in the same directory. That completely wiped out the /opt backup file and now I am solely left with the /var backup file. (as to why they decided to name the two backup files the same is beyond me)

At this point, I think I'm pretty much done. I am going to move to something that's not a manual upgrade process and requires a large amount of command line usage.

If any user data is stored in the /var/atlassian directory or if the user data was left untouched by the upgrade, please let me know where I can pull it out of as I would like to recover any data that I didn't wipe out.

Bill Bailey
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
November 2, 2021

Yeah, I typically create the backup before upgrade and copy to a safe location, but a bit late for that.

You may be at the point of just doing a clean insatll of 7.14.1, get that up and running, then restoring the site backup to the fresh install. I have had to do that before. Seems one wrong step can really set you off on a bad path.

0 votes
Bill Bailey
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
November 1, 2021

No, that is not normal. You can perform an upgrade in place. There are a few files that if you have changed (for example HTTPS), you will need to restore those.

There should have been questions when running the installer to point to your existing instance to upgrade, and make backups during the process.

Not sure if your login credentials are being pulled in from Active Directory or not, but I would highly recommend having at least one local, manually added admin account in Confluence. 

I have done this upgrade a few times, and it has always worked, but can be a bit of a pain, and you do have to reinstall some of the configuration manually, such as server.xml. I ALWAYS start with by making a full-site back up first. That way, if I have to complete start over, I can always import the site. 

I would start at this page and start searching for potential causes

https://confluence.atlassian.com/doc/upgrading-confluence-4578.html 

Deleted user November 2, 2021

Awesome, thanks! I found the backup zip file and will be going through it. The admin account is local to begin with, which is why I was confused about the login not working.

Bill Bailey
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
November 2, 2021

If this works for you, please accept the answer and/or like. We work for the clicks. ;-)

Suggest an answer

Log in or Sign up to answer
DEPLOYMENT TYPE
SERVER
VERSION
7.14.1
TAGS
AUG Leaders

Atlassian Community Events