Confluence fails to upgrade from 7.13.8 to 7.19.2

[AMP Admin Email Account]

Hi I'm trying to upgrade confluence in test environment from 7.13.8 to 7.19.2. But it fails with below error. Please suggest solution to overcome this issue.

2022-10-12 22:24:57,821 INFO [main] [com.atlassian.confluence.lifecycle] contextInitialized Starting Confluence 7.19.2 [build 8804 based on commit hash 4a8abee6f65948bd
ad19f90ec8049c38342c2851] - synchrony version 5.0.0
2022-10-12 22:25:02,646 INFO [main] [atlassian.confluence.cluster.DefaultClusterConfigurationHelper] lambda$populateExistingClusterSetupConfig$5 Populating setup config
uration if running with Cluster mode...
2022-10-12 22:25:04,303 WARN [main] [confluence.impl.setup.DefaultBootstrapDatabaseAccessor] lambda$getBootstrapData$3 Unable to determine finalized build number from d
atabase [message: ERROR: column "finalized" does not exist
Position: 48]. If you are upgrading from a Confluence version prior to 7.14, this is expected.
2022-10-12 22:25:04,609 INFO [main] [confluence.cluster.hazelcast.HazelcastClusterManager] configure Configuring Hazelcast with instanceName [confluence], join configur
ation AWS config (accessKey|iamRole|region|host header|security group|tag key|tag value: |UAT-ConfluenceApp-xx|ec2.ap-sou
theast-2.amazonaws.com|ConfluenceAppSharedSG-xxx||, network interfaces [xx.xx.xx.xx] and local port 5801
2022-10-12 22:25:04,609 INFO [main] [confluence.cluster.hazelcast.HazelcastClusterManager] startCluster Starting the cluster.
2022-10-12 22:25:08,395 INFO [hz.confluence.event-3] [confluence.cluster.hazelcast.LoggingClusterMembershipListener] memberAdded [10.165.181.223]:5801 joined the cluste
r
2022-10-12 22:25:08,400 INFO [hz.confluence.event-3] [confluence.cluster.hazelcast.LoggingClusterMembershipListener] logClusterMembers Cluster now has 1 members: [[10.1
65.181.223]:5801]
2022-10-12 22:25:13,695 WARN [main] [atlassian.hazelcast.micrometer.JmxBinder] bind No objects found for pattern com.hazelcast:type=HazelcastInstance.ConnectionManager,
*
2022-10-12 22:25:13,695 WARN [main] [atlassian.hazelcast.micrometer.JmxBinder] bind No objects found for pattern com.hazelcast:type=HazelcastInstance.EventService,*
2022-10-12 22:25:13,696 WARN [main] [atlassian.hazelcast.micrometer.JmxBinder] bind No objects found for pattern com.hazelcast:type=HazelcastInstance.OperationService,*
2022-10-12 22:25:13,696 WARN [main] [atlassian.hazelcast.micrometer.JmxBinder] bind No objects found for pattern com.hazelcast:type=HazelcastInstance.PartitionServiceMB
ean,*
2022-10-12 22:25:13,696 WARN [main] [atlassian.hazelcast.micrometer.JmxBinder] bind No objects found for pattern com.hazelcast:type=HazelcastInstance.ManagedExecutorSer
vice,*
2022-10-12 22:25:13,698 INFO [main] [confluence.cluster.hazelcast.HazelcastClusterManager] startCluster Confluence cluster node identifier is [4a11206b]
2022-10-12 22:25:13,777 INFO [main] [springframework.web.context.ContextLoader] initWebApplicationContext Root WebApplicationContext: initialization started
2022-10-12 22:25:19,830 INFO [main] [com.atlassian.confluence.lifecycle] <init> Loading EhCache cache manager
2022-10-12 22:25:36,272 INFO [main] [cluster.hazelcast.monitoring.HazelcastMembershipListener] init init: cluster ClusterService{address=[10.165.181.223]:5801}
2022-10-12 22:25:36,273 INFO [main] [cluster.hazelcast.monitoring.HazelcastMembershipListener] init init: cluster contains Member [10.165.181.223]:5801 - ab44dae8-5ae7-
485c-966c-90f74559e466 this
2022-10-12 22:25:37,922 INFO [main] [springframework.web.context.ContextLoader] initWebApplicationContext Root WebApplicationContext initialized in 24145 ms
2022-10-12 22:25:38,123 INFO [main] [atlassian.plugin.manager.DefaultPluginManager] lambda$earlyStartup$5 Plugin system earlyStartup begun
2022-10-12 22:25:43,915 WARN [FelixStartLevel] [extender.internal.support.ExtenderConfiguration] addDefaultDependencyFactories Gemini Blueprint extensions bundle not pr
esent, annotation processing disabled.
2022-10-12 22:26:20,292 WARN [main] [plugin.osgi.util.OsgiHeaderUtil] stripDuplicatePackages removing duplicate import package com.atlassian.confluence.api.service.netw
ork~ for plugin com.atlassian.streams.confluence - it is likely that a duplicate package was supplied in the OSGi instructions in the plugin's MANIFEST.MF
2022-10-12 22:28:34,733 WARN [main] [plugin.osgi.util.OsgiHeaderUtil] stripDuplicatePackages removing duplicate import package com.atlassian.confluence.api.service.acce
ssmode~ for plugin com.comalatech.workflow - it is likely that a duplicate package was supplied in the OSGi instructions in the plugin's MANIFEST.MF
2022-10-12 22:29:22,016 WARN [ThreadPoolAsyncTaskExecutor::Thread 15] [scanner.runtime.impl.ComponentImportBeanFactoryPostProcessor] loadServiceClass Unable to load cla
ss 'com.atlassian.jira.user.UserKeyService' for component importation purposes. Skipping...
2022-10-12 22:29:22,017 WARN [ThreadPoolAsyncTaskExecutor::Thread 15] [scanner.runtime.impl.ComponentImportBeanFactoryPostProcessor] loadServiceClass Unable to load class 'com.atlassian.jira.util.I18nHelper' for component importation purposes. Skipping...
2022-10-12 22:29:29,406 WARN [ThreadPoolAsyncTaskExecutor::Thread 10] [plugins.createcontent.extensions.BlueprintModuleDescriptor] init i18n-name-key is a required attribute of <blueprint> for module: com.adaptavist.confluence.contentFormattingMacros:cfm-blueprint
2022-10-12 22:29:41,677 INFO [main] [atlassian.plugin.manager.DefaultPluginManager] logTime Plugin system earlyStartup ended
2022-10-12 22:29:41,932 WARN [AtlassianEvent::CustomizableThreadFactory-1] [core.persistence.hibernate.HibernateVersionHistoryDao] getLatestBuildNumber Unable to determine build number from database. If you are upgrading from a Confluence version prior to 7.14.0, this is expected: ERROR: column "finalized" does not exist
Position: 48
2022-10-12 22:29:42,000 INFO [hz.confluence.event-5] [cluster.hazelcast.monitoring.HazelcastMembershipListener] memberAttributeChanged memberAttributeChanged: member Member [10.165.181.223]:5801 - ab44dae8-5ae7-485c-966c-90f74559e466 this, key confluence.node.tenant.arrived, value true
2022-10-12 22:29:43,670 INFO [main] [confluence.upgrade.impl.DefaultUpgradeManager] beforeUpgrade Generating pre-upgrade recovery file...
2022-10-12 22:29:43,805 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] begin Starting
2022-10-12 22:29:43,813 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Starting DATABASE_INFORMATION
2022-10-12 22:29:43,820 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Finishing DATABASE_INFORMATION
2022-10-12 22:29:43,820 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Starting TABLE_DEFINITION
2022-10-12 22:29:44,797 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Finishing TABLE_DEFINITION
2022-10-12 22:29:44,798 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] totalNumberOfTables Total number of tables: 290
2022-10-12 22:29:44,798 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Starting TABLES_DATA
2022-10-12 22:36:03,763 WARN [main] [confluence.impl.hibernate.ConfluenceHibernateTransactionManager] doRollback Performing rollback. Transactions:
->[null]: PROPAGATION_REQUIRES_NEW,ISOLATION_DEFAULT (Session #1794815006)
2022-10-12 22:36:03,807 ERROR [main] [springframework.transaction.support.TransactionTemplate] rollbackOnException Application exception overridden by rollback exception
com.atlassian.confluence.upgrade.recovery.DbDumpException: Failed to generate recovery file
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:86)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.beforeUpgrade(DefaultUpgradeManager.java:173)
at com.atlassian.confluence.upgrade.AbstractUpgradeManager.upgrade(AbstractUpgradeManager.java:134)
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.launchUpgrades(PluginFrameworkContextListener.java:122)
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.contextInitialized(PluginFrameworkContextListener.java:82)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4768)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5230)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:835)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:265)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.StandardService.startInternal(StandardService.java:432)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.startup.Catalina.start(Catalina.java:772)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
Caused by: com.atlassian.confluence.upgrade.recovery.DbDumpException: Problem with table "null":
at com.atlassian.confluence.upgrade.recovery.RecoveryErrorService.newImportExportSqlException(RecoveryErrorService.java:21)
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:57)
at com.atlassian.dbexporter.exporter.DataExporter.lambda$export$1(DataExporter.java:50)
at com.atlassian.dbexporter.jdbc.JdbcUtils.withConnection(JdbcUtils.java:29)
at com.atlassian.dbexporter.exporter.DataExporter.export(DataExporter.java:48)
at com.atlassian.dbexporter.DbExporter.exportData(DbExporter.java:65)
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:80)
... 36 more
Caused by: org.postgresql.util.PSQLException: This connection has been closed.
at org.postgresql.jdbc.PgConnection.checkClosed(PgConnection.java:907)
at org.postgresql.jdbc.PgConnection.setAutoCommit(PgConnection.java:836)
at org.apache.tomcat.dbcp.dbcp2.DelegatingConnection.setAutoCommit(DelegatingConnection.java:818)
at org.apache.tomcat.dbcp.dbcp2.DelegatingConnection.setAutoCommit(DelegatingConnection.java:818)
at com.atlassian.config.db.DelegatingConnection.setAutoCommit(DelegatingConnection.java:53)
at sun.reflect.GeneratedMethodAccessor338.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.atlassian.activeobjects.spi.ConnectionHandler.delegate(ConnectionHandler.java:39)
at com.atlassian.activeobjects.spi.ConnectionHandler.invoke(ConnectionHandler.java:34)
at com.sun.proxy.$Proxy2433.setAutoCommit(Unknown Source)
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:54)
... 41 more
2022-10-12 22:36:03,812 ERROR [main] [atlassian.confluence.plugin.PluginFrameworkContextListener] contextInitialized Error initialising plugin manager: Could not roll back Hibernate transaction; nested exception is net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection
org.springframework.transaction.TransactionSystemException: Could not roll back Hibernate transaction; nested exception is net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection
at org.springframework.orm.hibernate.HibernateTransactionManager.doRollback(HibernateTransactionManager.java:535)
at com.atlassian.confluence.impl.hibernate.ConfluenceHibernateTransactionManager.doRollback(ConfluenceHibernateTransactionManager.java:81)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.processRollback(AbstractPlatformTransactionManager.java:835)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.rollback(AbstractPlatformTransactionManager.java:809)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
at com.sun.proxy.$Proxy58.rollback(Unknown Source)
at org.springframework.transaction.support.TransactionTemplate.rollbackOnException(TransactionTemplate.java:168)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:144)
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.beforeUpgrade(DefaultUpgradeManager.java:173)
at com.atlassian.confluence.upgrade.AbstractUpgradeManager.upgrade(AbstractUpgradeManager.java:134)
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.launchUpgrades(PluginFrameworkContextListener.java:122)
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.contextInitialized(PluginFrameworkContextListener.java:82)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4768)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5230)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:835)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:265)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.StandardService.startInternal(StandardService.java:432)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.startup.Catalina.start(Catalina.java:772)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
Caused by: net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection
at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.rollback(AbstractLogicalConnectionImplementor.java:122)
at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.rollback(JdbcResourceLocalTransactionCoordinatorImpl.java:251)
at org.hibernate.engine.transaction.internal.TransactionImpl.rollback(TransactionImpl.java:100)
at com.atlassian.hibernate.adapter.adapters.TransactionV2Adapter.rollback(TransactionV2Adapter.java:44)
at org.springframework.orm.hibernate.HibernateTransactionManager.doRollback(HibernateTransactionManager.java:532)
... 47 more
Caused by: org.postgresql.util.PSQLException: This connection has been closed.
at org.postgresql.jdbc.PgConnection.checkClosed(PgConnection.java:907)
at org.postgresql.jdbc.PgConnection.rollback(PgConnection.java:914)
at org.apache.tomcat.dbcp.dbcp2.DelegatingConnection.rollback(DelegatingConnection.java:798)
at org.apache.tomcat.dbcp.dbcp2.DelegatingConnection.rollback(DelegatingConnection.java:798)
at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.rollback(AbstractLogicalConnectionImplementor.java:116)
... 51 more
2022-10-12 22:36:03,827 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Waiting to find if plugin dependent upgrades are required. Maximum wait time will be 90 seconds.
2022-10-12 22:36:03,827 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue plugin dependent upgrades are required : true.
2022-10-12 22:36:03,830 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Waiting to find if plugin dependent upgrades are complete. Maximum wait time will be 1800 seconds.
2022-10-12 22:40:33,834 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Still waiting to find if plugin dependent upgrades are complete. Remaining wait time is 1500 seconds.
2022-10-12 22:45:33,837 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Still waiting to find if plugin dependent upgrades are complete. Remaining wait time is 1200 seconds.
2022-10-12 22:50:33,841 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Still waiting to find if plugin dependent upgrades are complete. Remaining wait time is 900 seconds.
2022-10-12 22:55:33,845 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Still waiting to find if plugin dependent upgrades are complete. Remaining wait time is 600 seconds.
2022-10-12 23:00:33,849 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Still waiting to find if plugin dependent upgrades are complete. Remaining wait time is 300 seconds.
2022-10-12 23:05:33,852 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Still waiting to find if plugin dependent upgrades are complete. Remaining wait time is 0 seconds.
2022-10-12 23:06:03,853 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Timed out waiting to find if plugin dependent upgrades are complete. Default to false.
2022-10-12 23:06:03,853 INFO [main] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue plugin dependent upgrades are complete : false.
2022-10-12 23:06:03,854 INFO [main] [confluence.upgrade.impl.DefaultUpgradeManager] entireUpgradeFinished Generating post-upgrade recovery file...
2022-10-12 23:06:04,170 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] begin Starting
2022-10-12 23:06:04,170 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Starting DATABASE_INFORMATION
2022-10-12 23:06:04,171 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Finishing DATABASE_INFORMATION
2022-10-12 23:06:04,171 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Starting TABLE_DEFINITION
2022-10-12 23:06:04,990 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Finishing TABLE_DEFINITION
2022-10-12 23:06:04,990 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] totalNumberOfTables Total number of tables: 290
2022-10-12 23:06:04,990 INFO [main] [confluence.upgrade.recovery.ConfluenceProgressMonitor] logTask Starting TABLES_DATA
2022-10-12 23:18:03,809 WARN [main] [confluence.impl.hibernate.ConfluenceHibernateTransactionManager] doRollback Performing rollback. Transactions:
->[null]: PROPAGATION_REQUIRES_NEW,ISOLATION_DEFAULT (Session #495389844)
2022-10-12 23:18:03,811 ERROR [main] [springframework.transaction.support.TransactionTemplate] rollbackOnException Application exception overridden by rollback exceptio
n
com.atlassian.confluence.upgrade.recovery.DbDumpException: Failed to generate recovery file
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:86)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.entireUpgradeFinished(DefaultUpgradeManager.java:262)
at com.atlassian.confluence.upgrade.PluginFrameworkDependentUpgrader.startup(PluginFrameworkDependentUpgrader.java:27)
at com.atlassian.confluence.impl.setup.DefaultLifecycleManager.startUp(DefaultLifecycleManager.java:52)
at com.atlassian.config.lifecycle.LifecycleServletContextListener.contextInitialized(LifecycleServletContextListener.java:15)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4768)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5230)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:835)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:265)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.StandardService.startInternal(StandardService.java:432)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.startup.Catalina.start(Catalina.java:772)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
Caused by: com.atlassian.confluence.upgrade.recovery.DbDumpException: Problem with table "null":
at com.atlassian.confluence.upgrade.recovery.RecoveryErrorService.newImportExportSqlException(RecoveryErrorService.java:21)
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:57)
at com.atlassian.dbexporter.exporter.DataExporter.lambda$export$1(DataExporter.java:50)
at com.atlassian.dbexporter.jdbc.JdbcUtils.withConnection(JdbcUtils.java:29)
at com.atlassian.dbexporter.exporter.DataExporter.export(DataExporter.java:48)
at com.atlassian.dbexporter.DbExporter.exportData(DbExporter.java:65)
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:80)
... 36 more
Caused by: org.postgresql.util.PSQLException: This connection has been closed.
at org.postgresql.jdbc.PgConnection.checkClosed(PgConnection.java:907)
at org.postgresql.jdbc.PgConnection.setAutoCommit(PgConnection.java:836)
at org.apache.tomcat.dbcp.dbcp2.DelegatingConnection.setAutoCommit(DelegatingConnection.java:818)
at org.apache.tomcat.dbcp.dbcp2.DelegatingConnection.setAutoCommit(DelegatingConnection.java:818)
at com.atlassian.config.db.DelegatingConnection.setAutoCommit(DelegatingConnection.java:53)
at sun.reflect.GeneratedMethodAccessor338.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
2022-10-12 23:18:03,812 ERROR [main] [atlassian.config.lifecycle.LifecycleManager] panicAndShutdown Unable to start up Confluence. Fatal error during startup sequence: confluence.lifecycle.core:pluginframeworkdependentupgrades (Run all the upgrades that require the plugin framework to be available)
org.springframework.transaction.TransactionSystemException: Could not roll back Hibernate transaction; nested exception is net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection
at org.springframework.orm.hibernate.HibernateTransactionManager.doRollback(HibernateTransactionManager.java:535)
at com.atlassian.confluence.impl.hibernate.ConfluenceHibernateTransactionManager.doRollback(ConfluenceHibernateTransactionManager.java:81)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.processRollback(AbstractPlatformTransactionManager.java:835)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.rollback(AbstractPlatformTransactionManager.java:809)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
at com.sun.proxy.$Proxy58.rollback(Unknown Source)
at org.springframework.transaction.support.TransactionTemplate.rollbackOnException(TransactionTemplate.java:168)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:144)
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.entireUpgradeFinished(DefaultUpgradeManager.java:262)
at com.atlassian.confluence.upgrade.PluginFrameworkDependentUpgrader.startup(PluginFrameworkDependentUpgrader.java:27)
at com.atlassian.confluence.impl.setup.DefaultLifecycleManager.startUp(DefaultLifecycleManager.java:52)
at com.atlassian.config.lifecycle.LifecycleServletContextListener.contextInitialized(LifecycleServletContextListener.java:15)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4768)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5230)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:835)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:265)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.StandardService.startInternal(StandardService.java:432)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.startup.Catalina.start(Catalina.java:772)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
Caused by: net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection
at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.rollback(AbstractLogicalConnectionImplementor.java:122)
at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.rollback(JdbcResourceLocalTransactionCoordinatorImpl.java:251)
at org.hibernate.engine.transaction.internal.TransactionImpl.rollback(TransactionImpl.java:100)
at com.atlassian.hibernate.adapter.adapters.TransactionV2Adapter.rollback(TransactionV2Adapter.java:44)
at org.springframework.orm.hibernate.HibernateTransactionManager.doRollback(HibernateTransactionManager.java:532)
... 47 more
Caused by: org.postgresql.util.PSQLException: This connection has been closed.
at org.postgresql.jdbc.PgConnection.checkClosed(PgConnection.java:907)
at org.postgresql.jdbc.PgConnection.rollback(PgConnection.java:914)
at org.apache.tomcat.dbcp.dbcp2.DelegatingConnection.rollback(DelegatingConnection.java:798)
at org.apache.tomcat.dbcp.dbcp2.DelegatingConnection.rollback(DelegatingConnection.java:798)
at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.rollback(AbstractLogicalConnectionImplementor.java:116)
... 51 more
2022-10-12 23:18:03,818 INFO [main] [com.atlassian.confluence.lifecycle] destroy Shutting down long running task service
2022-10-12 23:18:05,077 INFO [main] [com.atlassian.confluence.lifecycle] init Confluence is ready to serve

And even though it shows that confluence is ready to serve, it's doesn't open and in AWS it shows as "Health checks failed with these codes: [503]"

[Pushpanjali Shivaramu]

Hi,

Hope you are doing well, Thanks for contacting us!

I can see from the log that the upgrade recovery file is not generated as there is Data base connection time out.

Please note that generating the recovery file can take long time on sites that are medium sized or larger, and can be safely turned off if you have a robust process to back up your database and verify the backup before performing an upgrade. 

Log snippet:

>[null]: PROPAGATION_REQUIRES_NEW,ISOLATION_DEFAULT (Session #1794815006)
2022-10-12 22:36:03,807 ERROR [main] [springframework.transaction.support.TransactionTemplate] rollbackOnException Application exception 
overridden by rollback exception
com.atlassian.confluence.upgrade.recovery.DbDumpException: Failed to generate recovery file
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:86)

Please disable the upgrade recovery file generation by following the steps mentioned in below KB: 

https://confluence.atlassian.com/confkb/how-to-disable-upgrade-recovery-file-generation-in-confluence-1047534410.html

Kindly let us know if this solution helped. Have a great day!!

Regards,

Pushpanjali S