Confluence 7.4.1 to 7.13.0 upgrading failed to start

Question

I was upgrading Confluence v7.4.1 to v7.13.0. However, it failed to start with the following error on loading webpage after upgrading:

Pre-upgrade validation failed. Check the Confluence application logs for more details. You'll need to fix these problems and restart Confluence before you can upgrade. Upgrade error message: Cannot update schema

I can see the following error in the log:

2021-09-20 17:46:19,518 WARN [perm-delta-cache-receiver] [confluence.impl.hibernate.ConfluenceHibernateTransactionManager] doRollback Performing rollback. Transactions:
->[PluginReadWriteTx]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT (Session #1284960569)
2021-09-20 17:46:19,520 ERROR [perm-delta-cache-receiver] [gatekeeper.evaluator.cache.CacheUpdateReceiver] error Failed to initialize evaluator cache
org.springframework.dao.InvalidDataAccessResourceUsageException: could not extract ResultSet; SQL [n/a]; nested exception is org.hibernate.exception.SQLGrammarException: could not extract ResultSet
at org.springframework.orm.hibernate5.SessionFactoryUtils.convertHibernateAccessException(SessionFactoryUtils.java:228)
at org.springframework.orm.hibernate5.HibernateTemplate.doExecute(HibernateTemplate.java:388)
...
Caused by: java.sql.SQLSyntaxErrorException: ORA-00904: "THIS_"."EXTERNAL_ID": invalid identifier
...
Caused by: Error : 904, Position : 390, Sql = select this_.id as id1_28_0_, this_.group_name as group_name2_28_0_, this_.lower_group_name as lower_group_name3_28_0_, this_.active as active4_28_0_, this_.local as local5_28_0_, this_.created_date as created_date6_28_0_, this_.updated_date as updated_date7_28_0_, this_.description as description8_28_0_, this_.group_type as group_type9_28_0_, this_.directory_id as directory_id10_28_0_, this_.external_id as external_id11_28_0_ from cwd_group this_ where this_.lower_group_name=:1 and this_.directory_id=:2 , OriginalSql = select this_.id as id1_28_0_, this_.group_name as group_name2_28_0_, this_.lower_group_name as lower_group_name3_28_0_, this_.active as active4_28_0_, this_.local as local5_28_0_, this_.created_date as created_date6_28_0_, this_.updated_date as updated_date7_28_0_, this_.description as description8_28_0_, this_.group_type as group_type9_28_0_, this_.directory_id as directory_id10_28_0_, this_.external_id as external_id11_28_0_ from cwd_group this_ where this_.lower_group_name=? and this_.directory_id=?, Error Msg = ORA-00904: "THIS_"."EXTERNAL_ID": invalid identifier

Any suggestion? Thanks

Alex Perez · Answer

the same exact process but upgrading to 7.12.5 is working fine.

unless you have requirements to upgrade to 7.13 i'll recommend you to stop in 7.12.x ...

HTH

Alex Perez · Answer

Same error with 7.13.1.

2021-09-27 11:06:57,244 INFO [Catalina-utility-1] [confluence.upgrade.recovery.ConfluenceProgressMonitor] end TABLE_DATA: [AO_88263F_READ_NOTIFICATIONS]
2021-09-27 11:06:57,244 INFO [Catalina-utility-1] [confluence.upgrade.recovery.ConfluenceProgressMonitor] begin TABLE_DATA: [AO_88BB94_BATCH_NOTIFICATION]
2021-09-27 11:06:57,244 INFO [Catalina-utility-1] [confluence.upgrade.recovery.ConfluenceProgressMonitor] end TABLE_DATA: [AO_88BB94_BATCH_NOTIFICATION]
2021-09-27 11:06:57,245 INFO [Catalina-utility-1] [confluence.upgrade.recovery.ConfluenceProgressMonitor] begin TABLE_DATA: [AO_92296B_AORECENTLY_VIEWED]
2021-09-27 11:06:57,245 INFO [Catalina-utility-1] [confluence.upgrade.recovery.ConfluenceProgressMonitor] end TABLE_DATA: [AO_92296B_AORECENTLY_VIEWED]
2021-09-27 11:06:57,245 INFO [Catalina-utility-1] [confluence.upgrade.recovery.ConfluenceProgressMonitor] begin TABLE_DATA: [AO_9412A1_AONOTIFICATION]
2021-09-27 11:06:57,246 INFO [Catalina-utility-1] [confluence.upgrade.recovery.ConfluenceProgressMonitor] end TABLE_DATA: [AO_9412A1_AONOTIFICATION]
2021-09-27 11:06:57,246 INFO [Catalina-utility-1] [confluence.upgrade.recovery.ConfluenceProgressMonitor] begin TABLE_DATA: [AO_9412A1_AOREGISTRATION]
2021-09-27 11:06:57,266 ERROR [perm-delta-cache-receiver] [engine.jdbc.spi.SqlExceptionHelper] logExceptions ORA-00904: "THIS_"."EXTERNAL_ID": invalid identi
fier

2021-09-27 11:06:57,267 WARN [perm-delta-cache-receiver] [confluence.impl.hibernate.ConfluenceHibernateTransactionManager] doRollback Performing rollback. Tr
ansactions:
->[PluginReadWriteTx]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT (Session #1962207383)
2021-09-27 11:06:57,268 ERROR [perm-delta-cache-receiver] [gatekeeper.evaluator.cache.CacheUpdateReceiver] error Failed to initialize evaluator cache
org.springframework.dao.InvalidDataAccessResourceUsageException: could not extract ResultSet; SQL [n/a]; nested exception is org.hibernate.exception.SQLGramm
arException: could not extract ResultSet
at org.springframework.orm.hibernate5.SessionFactoryUtils.convertHibernateAccessException(SessionFactoryUtils.java:228)
at org.springframework.orm.hibernate5.HibernateTemplate.doExecute(HibernateTemplate.java:388)
at org.springframework.orm.hibernate5.HibernateTemplate.execute(HibernateTemplate.java:337)
at com.atlassian.crowd.embedded.hibernate2.HibernateGroupDao.internalFindByName(HibernateGroupDao.java:479)
at com.atlassian.crowd.embedded.hibernate2.HibernateGroupDao.findByName(HibernateGroupDao.java:82)
at com.atlassian.confluence.impl.user.crowd.CachedCrowdGroupDao.findGroupInternal(CachedCrowdGroupDao.java:78)

Alex Perez · Answer

Same here, weird error about non-existing resultset in 7.13.0.

I'm about to test the upgrade to 7.13.1

(RHEL7 - Oracle 19c)

BTW, the upgrade worked fine in one environment (DEV with small dataset), but currently failing in QA env (same data amount as PROD).