Jira Software Full Re-Index is stuck on 0%

Question

1. We connected production Oracle DB to our Test server

2. Jira process is restarted , but I can not create issues. Also Jira runs slow

3. Decided to re-index, but it only allows me to do a full re-index (incremental is not be chosen)

4. Started a full re-index, but after 24h, it is still at 0% complete.

catalina.out:

catalina.out:78145:2024-01-10 16:53:49,012-0600 Caesium-1-1 INFO      [c.a.jira.upgrade.UpgradeIndexManager] There are no reindex requests of type [IMMEDIATE, DELAYED] so none will be run

catalina.out:78151:2024-01-10 16:53:49,325-0600 Caesium-1-1 INFO      [c.a.jira.upgrade.UpgradeIndexManager] Reindexing is not allowed after this upgrade and there is no immediate reindex requests

catalina.out:78153:2024-01-10 16:53:49,448-0600 Caesium-1-4 INFO      [c.a.jira.startup.IndexRecoveryLauncher] Running start-index-recovery

catalina.out:78155:2024-01-10 16:53:49,929-0600 Caesium-1-4 ERROR      [c.a.jira.startup.IndexRecoveryLauncher] [INDEX-FIXER] Issue index is out of date with the database (issue_version) by more than 48 hours. Automatic recovery will not be attempted

then  com.atlassian.jira.util.index.CompositeIndexLifecycleManager.shutdown(CompositeIndexLifecycleManager.java:147)

Any ideas are appreciated!

Olga Mill · Answer

This log entry was appearing before we upgraded the device. this log entry is not relevant any more

O M_f4np8w · Answer

Thank you for your answer. I have also confirmed that a power user (not me), who is capable of creating issues is not able to create an issue (so it is not just my problem). When we try to create an issue, JIRA is just  'spinning' after we click on the "submit issue" button.  I am pretty sure I was able to create issues on this system before.

Yes, I am currently trying to fix the test environment.

Jira GUI is sluggish because the buttons on the top of the screen (such as Projects, Issues, etc) render very slow, and eventually appear, but it takes a couple of minutes for them to do so.  A restart of a JIRA process seems to help that issue, but this sluggishness comes back after a few hours.

I will check the CPU, disk input/output. Thank you for your help!

Nic Brough -Adaptavist- · Answer

Ok, that's good and bad.  Good because you've done the right thing, and in almost exactly the way I would.   But bad because it rules out the one thing that would definitely be a problem, so we do not have a quick fix.

The only bit left on that is that I am assuming that the test system is the sluggish one, not production, from here on.

Having Jira admin just means you can administrate the system, it does not mean "can do everything", you may need to grant yourself more project permissions, but it's also a useful test in itself:

* Are your admin rights in Production the same?   Have they been inherited by the database copy, in other words.  More importantly, are your project rights in Production the same (at least for any project you want to use for investigating)?  What errors or symptoms are you getting when you try to create an issue?
* What bits of Jira are sluggish for you?  Obviously, I assume it's stuff like "create / transition / edit issues", but there's a set of problems that have a symptom of "most, if not everything, in a project is slow", but the Jira and System administrators find that the admin screens all run at a decent speed.

While either your full, locking, re-index, or the index recovery, are running, could you take a look at what the server is doing?  Start with a look at the memory, CPU and disk input/output look like, and whether the Jira process is a huge load on any of them.