Hi all!I have installed jira core 9.11.1 and jsm 5.11.1 in dc mode via custom helm chart in gcp k8s.When there is one node in cluster, creating ticket on the top menu is working. If I try to add a second node to cluster, creating a ticket is not working. I just see that the browser hangs indefinitely with a spinning logo at the center.I have tried to fix it by:1) Re-indexing and full re-indexing.2) Copy index from one node to another.3) Checking database integrity check.4) Turning off all plugins one by one.5) Removing information about second node from database and removing the pod pvc.6) Checking clustering page and have seen no issue found.7) Checking Troubleshooting and support tools and have seen no issues found.How to fix the issue?
@Игорь Самарский When creating the ticket, do you see any errors in the application logs? (jira_home> logs >atlassian-jira.log)?
I have turned on debug mode for logger below and turned off other ones.In log, I have seen the following:2023-09-28 09:38:16,947+0000 localq-stats-0 INFO [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [scheduled] Running cache replication queue stats for: 0 queues...2023-09-28 09:38:16,948+0000 localq-stats-0 INFO [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [scheduled] ... done running cache replication queue stats for: 0 queues.2023-09-28 09:38:29,017+0000 RMI TCP Connection(1)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Connection accepted from: Socket[addr=/10.61.17.56,port=57284,localport=40001]. Starting authentication...2023-09-28 09:38:29,021+0000 RMI TCP Connection(1)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Setting socket timeout for authentication to: 10000 millis2023-09-28 09:38:29,022+0000 RMI TCP Connection(1)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Setting socket TCP_NODELAY for authentication to: true...2023-09-28 09:38:29,412+0000 cluster-watchdog-0 INFO [c.a.j.c.d.localq.tape.TapeLocalQCacheOpQueue] [LOCALQ] [VIA-INVALIDATION] Created persistent cache replication queue for node: service-desk-1 with id: queue_servicedesk1_3_e90a999b81998f647a9bb663b14222fa in : /var/atlassian/application-data/jira/localq/queue_servicedesk1_3_e90a999b81998f647a9bb663b14222fa2023-09-28 09:38:29,413+0000 cluster-watchdog-0 INFO [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Created cache replication queue: [queueId=queue_servicedesk1_3_e90a999b81998f647a9bb663b14222fa, queuePath=/var/atlassian/application-data/jira/localq/queue_servicedesk1_3_e90a999b81998f647a9bb663b14222fa] with queue reader running: true2023-09-28 09:38:29,414+0000 localq-reader-2 INFO [c.a.j.c.distribution.localq.LocalQCacheOpReader] [LOCALQ] [VIA-INVALIDATION] Started listening for cache replication queue: [queueId=queue_servicedesk1_2_e90a999b81998f647a9bb663b14222fa, queuePath=/var/atlassian/application-data/jira/localq/queue_servicedesk1_2_e90a999b81998f647a9bb663b14222fa]2023-09-28 09:38:29,421+0000 cluster-watchdog-0 INFO [c.a.j.c.d.localq.tape.TapeLocalQCacheOpQueue] [LOCALQ] [VIA-INVALIDATION] Created persistent cache replication queue for node: service-desk-1 with id: queue_servicedesk1_4_e90a999b81998f647a9bb663b14222fa in : /var/atlassian/application-data/jira/localq/queue_servicedesk1_4_e90a999b81998f647a9bb663b14222fa...2023-09-28 09:38:31,379+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Restoring socket timeout back to: 7200000 millis2023-09-28 09:38:31,380+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Restoring socket TCP_NODELAY back to: true2023-09-28 09:38:31,381+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Authentication OK: Cluster authentication successful...2023-09-28 09:38:31,394+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.project.util.CachingProjectKeyStore.cache: remote remove received for key: com.atlassian.cache.impl.ReferenceKey@02023-09-28 09:38:31,561+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.security.GlobalPermissionsCache.permissions: remote remove received for key: com.atlassian.cache.impl.ReferenceKey@02023-09-28 09:38:33,293+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.issue.fields.screen.CachingFieldScreenStore.allScreensCache: remote remove received for key: com.atlassian.cache.impl.ReferenceKey@02023-09-28 09:38:33,302+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.issue.fields.screen.CachingFieldScreenStore.fieldScreenCache: remote removeAll received2023-09-28 09:38:34,111+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.issue.customfields.manager.CachedOptionsManager.optionsCache: remote removeAll received2023-09-28 09:38:34,121+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.issue.customfields.manager.CachedOptionsManager.optionCache: remote removeAll received2023-09-28 09:38:34,130+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.issue.customfields.manager.CachedOptionsManager.parentCache: remote removeAll received2023-09-28 09:38:34,140+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.issue.customfields.manager.CachedOptionsManager.valueCache: remote removeAll received2023-09-28 09:38:34,148+0000 RMI TCP Connection(4)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.issue.customfields.manager.CachedOptionsManager.allCache: remote remove received for key: com.atlassian.cache.impl.ReferenceKey@0...2023-09-28 09:38:41,625+0000 ipd-worker:thread-1 DEBUG [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='ipd-periodic-cache-invalidation', action=REMOVE, key=cache-key, value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695893921621} to cache replication queues: 1...2023-09-28 09:38:41,631+0000 ipd-worker:thread-1 DEBUG [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='ipd-periodic-cache-invalidation', action=REMOVE, key=cache-key, value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695893921621} to cache replication queues: 1.2023-09-28 09:38:41,634+0000 localq-reader-4 DEBUG [c.a.j.c.d.localq.rmi.CachingRMICachePeerManager] [LOCALQ] Creating cache peer for node: service-desk-1 and cacheName: ipd-periodic-cache-invalidation, node: Node{nodeId='service-desk-1', state=ACTIVE, timestamp=1695893908901, ip='10.61.17.56', cacheListenerPort=40001, nodeBuildNumber=9110001, nodeVersion='9.11.1'}2023-09-28 09:38:41,635+0000 localq-reader-4 DEBUG [c.a.j.c.d.localq.rmi.BasicRMICachePeerProvider] [LOCALQ] Creating cache peer for node: service-desk-1 and cacheName: ipd-periodic-cache-invalidation...the most interesting part2023-09-28 09:38:41,713+0000 localq-reader-4 DEBUG [c.a.j.c.d.localq.rmi.CachingRMICachePeerManager] [LOCALQ] Creating cache peer for node: service-desk-1 and cacheName: ipd-periodic-cache-invalidation, node: Node{nodeId='service-desk-1', state=ACTIVE, timestamp=1695893908901, ip='10.61.17.56', cacheListenerPort=40001, nodeBuildNumber=9110001, nodeVersion='9.11.1'}2023-09-28 09:38:41,713+0000 localq-reader-4 DEBUG [c.a.j.c.d.localq.rmi.BasicRMICachePeerProvider] [LOCALQ] Creating cache peer for node: service-desk-1 and cacheName: ipd-periodic-cache-invalidation2023-09-28 09:38:41,720+0000 localq-reader-4 WARN [c.a.j.c.distribution.localq.LocalQCacheOpReader] [LOCALQ] [VIA-INVALIDATION] Abandoning sending because cache does not exist on destination node: LocalQCacheOp{cacheName='ipd-periodic-cache-invalidation', action=REMOVE, key=cache-key, value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695893921621} from cache replication queue: [queueId=queue_servicedesk1_4_e90a999b81998f647a9bb663b14222fa, queuePath=/var/atlassian/application-data/jira/localq/queue_servicedesk1_4_e90a999b81998f647a9bb663b14222fa], failuresCount: 2/2. Removing from queue. Error: ipd-periodic-cache-invalidationjava.rmi.NotBoundException: ipd-periodic-cache-invalidation...2023-09-28 09:38:46,627+0000 Caesium-1-3 DEBUG ServiceRunner [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-COPY] No nodes in cluster to replicate: LocalQCacheOp{cacheName='com.atlassian.cluster.monitoring.spi.ClusterMonitoring.cache', action=PUT, key=CustomSerializedValue{value=nodeKey{nodeId='service-desk-0', key='com.atlassian.jira.plugin.cluster.monitoring.internal.job.ApplicationStatusCollector'}, isValueSerializable='true', pluginKey='com.atlassian.jira.jira-cluster-monitoring-plugin'}, value == null ? false, replicatePutsViaCopy=true, creationTimeInMillis=1695893926627}2023-09-28 09:38:46,675+0000 Caesium-1-2 DEBUG ServiceRunner [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-COPY] No nodes in cluster to replicate: LocalQCacheOp{cacheName='com.atlassian.cluster.monitoring.spi.ClusterMonitoring.cache', action=PUT, key=CustomSerializedValue{value=nodeKey{nodeId='service-desk-0', key='com.atlassian.cluster.monitoring.cluster-monitoring-plugin:runtime-information'}, isValueSerializable='true', pluginKey='com.atlassian.jira.jira-cluster-monitoring-plugin'}, value == null ? false, replicatePutsViaCopy=true, creationTimeInMillis=1695893926675}2023-09-28 09:38:46,706+0000 Caesium-1-3 DEBUG ServiceRunner [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-COPY] No nodes in cluster to replicate: LocalQCacheOp{cacheName='com.atlassian.jira.plugins.healthcheck.service.HeartBeatService.heartbeat', action=PUT, key=service-desk-0, value == null ? false, replicatePutsViaCopy=true, creationTimeInMillis=1695893926706}2023-09-28 09:38:46,727+0000 Caesium-1-2 DEBUG ServiceRunner [c.a.jira.cluster.DefaultClusterManager] [CLUSTER-STATE] Node service-desk-1 does not have heartbeat so his absence in cluster is calculated based on the timestampit showed up several time and the I got2023-09-28 09:40:50,399+0000 localq-reader-4 DEBUG [c.a.j.c.d.l.rmi.auth.SharedSecretClusterAuthService] [JIRA-RMI-AUTH] [CLIENT] authentication finished at PT0.001463179Smillis2023-09-28 09:40:50,399+0000 localq-reader-4 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthRMIClientSocketFactoryHelper] [JIRA-RMI-AUTH] [SERVER] Restoring socket TCP_NODELAY back to: false2023-09-28 09:40:50,400+0000 localq-reader-4 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthRMIClientSocketFactoryHelper] [JIRA-RMI-AUTH] [CLIENT] Successfully created RMI client socket to host: 10.61.17.56 port: 400112023-09-28 09:40:51,356+0000 ClusterMessageHandlerServiceThread:thread-1 DEBUG [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='com.atlassian.jira.service.DefaultServiceManager.servicesReference', action=REMOVE, key=com.atlassian.cache.impl.ReferenceKey@0, value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894051356} to cache replication queues: 1...2023-09-28 09:40:51,360+0000 ClusterMessageHandlerServiceThread:thread-1 DEBUG [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='com.atlassian.jira.service.DefaultServiceManager.servicesReference', action=REMOVE, key=com.atlassian.cache.impl.ReferenceKey@0, value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894051356} to cache replication queues: 1.2023-09-28 09:40:51,361+0000 localq-reader-2 DEBUG [c.a.j.c.d.localq.rmi.CachingRMICachePeerManager] [LOCALQ] Creating cache peer for node: service-desk-1 and cacheName: com.atlassian.jira.service.DefaultServiceManager.servicesReference, node: Node{nodeId='service-desk-1', state=ACTIVE, timestamp=1695893908901, ip='10.61.17.56', cacheListenerPort=40001, nodeBuildNumber=9110001, nodeVersion='9.11.1'}2023-09-28 09:40:51,361+0000 localq-reader-2 DEBUG [c.a.j.c.d.localq.rmi.BasicRMICachePeerProvider] [LOCALQ] Creating cache peer for node: service-desk-1 and cacheName: com.atlassian.jira.service.DefaultServiceManager.servicesReference...2023-09-28 09:41:14,270+0000 RMI TCP Connection(8)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.qotilabs.jira.rich-filters-plugin:RichFiltersManagerCachingImpl.rich-filters-cache: remote removeAll received2023-09-28 09:41:14,325+0000 RMI TCP Connection(8)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.qotilabs.jira.rich-filters-plugin:RichFiltersManagerCachingImpl.rich-filters-cache: remote removeAll received2023-09-28 09:41:14,391+0000 RMI TCP Connection(8)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.qotilabs.jira.rich-filters-plugin:RichFiltersManagerCachingImpl.rich-filters-cache: remote removeAll received2023-09-28 09:41:14,466+0000 RMI TCP Connection(8)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.qotilabs.jira.rich-filters-plugin:RichFiltersManagerCachingImpl.rich-filters-cache: remote removeAll received2023-09-28 09:41:14,589+0000 RMI TCP Connection(8)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.qotilabs.jira.rich-filters-plugin:RichFiltersManagerCachingImpl.rich-filters-cache: remote removeAll receivedI cant uderstandt why it is repeated several times2023-09-28 09:41:31,508+0000 RMI TCP Connection(16)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Restoring socket timeout back to: 7200000 millis2023-09-28 09:41:31,509+0000 RMI TCP Connection(16)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Restoring socket TCP_NODELAY back to: true2023-09-28 09:41:31,509+0000 RMI TCP Connection(16)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Authentication OK: Cluster authentication successful2023-09-28 09:41:31,492+0000 RMI TCP Connection(15)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Connection accepted from: Socket[addr=/10.61.17.56,port=54072,localport=40011]. Starting authentication...2023-09-28 09:41:31,511+0000 RMI TCP Connection(15)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Setting socket timeout for authentication to: 10000 millis2023-09-28 09:41:31,512+0000 RMI TCP Connection(15)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Setting socket TCP_NODELAY for authentication to: true2023-09-28 09:41:31,512+0000 RMI TCP Connection(15)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.SharedSecretClusterAuthService] [JIRA-RMI-AUTH] [SERVER] authentication started at 0millis2023-09-28 09:41:31,514+0000 RMI TCP Connection(16)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.migration.tracking.polling.InProgressMigrationIds.cache: remote remove received for key: inProgMigs2023-09-28 09:41:31,523+0000 RMI TCP Connection(16)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache com.atlassian.jira.issue.fields.config.persistence.CachedFieldConfigSchemePersister.fieldConfigSchemeIssueTypesBySchemeId: remote remove received for key: com.atlassian.cache.impl.ReferenceKey@02023-09-28 09:41:31,523+0000 RMI TCP Connection(15)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.SharedSecretClusterAuthService] [JIRA-RMI-AUTH] [SERVER] authentication finished at PT0.01088846Smillis2023-09-28 09:41:31,524+0000 RMI TCP Connection(15)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Restoring socket timeout back to: 7200000 millis2023-09-28 09:41:31,527+0000 RMI TCP Connection(15)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Restoring socket TCP_NODELAY back to: true2023-09-28 09:41:31,527+0000 RMI TCP Connection(15)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.auth.ClusterAuthServerSocket] [JIRA-RMI-AUTH] [SERVER] Authentication OK: Cluster authentication successfulMaybe there is a timeout problem?...2023-09-28 09:41:41,617+0000 localq-reader-4 DEBUG [c.a.j.c.d.localq.rmi.CachingRMICachePeerManager] [LOCALQ] Creating cache peer for node: service-desk-1 and cacheName: ipd-periodic-cache-invalidation, node: Node{nodeId='service-desk-1', state=ACTIVE, timestamp=1695893908901, ip='10.61.17.56', cacheListenerPort=40001, nodeBuildNumber=9110001, nodeVersion='9.11.1'}2023-09-28 09:41:41,617+0000 localq-reader-4 DEBUG [c.a.j.c.d.localq.rmi.BasicRMICachePeerProvider] [LOCALQ] Creating cache peer for node: service-desk-1 and cacheName: ipd-periodic-cache-invalidationIn the end I got it2023-09-28 09:44:55,403+0000 http-nio-8080-exec-8 url: /plugins/servlet/cluster-monitoring DEBUG HIDDEN_USER 584x4910x1 - 212.112.118.110,10.61.17.5 /plugins/servlet/cluster-monitoring [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894295403} to cache replication queues: 1...2023-09-28 09:44:55,408+0000 http-nio-8080-exec-8 url: /plugins/servlet/cluster-monitoring DEBUG HIDDEN_USER 584x4910x1 - 212.112.118.110,10.61.17.5 /plugins/servlet/cluster-monitoring [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894295403} to cache replication queues: 1.2023-09-28 09:44:55,984+0000 RMI TCP Connection(21)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache UserPropertyManager.ApplicationUser.cache: remote remove received for key: CacheKey[entityName=ApplicationUser,entityId=12801]2023-09-28 09:44:56,045+0000 RMI TCP Connection(21)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache UserPropertyManager.ApplicationUser.cache: remote remove received for key: CacheKey[entityName=ApplicationUser,entityId=12801]2023-09-28 09:44:56,053+0000 RMI TCP Connection(21)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache UserPropertyManager.ApplicationUser.cache: remote remove received for key: CacheKey[entityName=ApplicationUser,entityId=12801]2023-09-28 09:44:56,172+0000 http-nio-8080-exec-2 url: /rest/insight/1.0/user/got/message/rlabs.insight.i18n.dc.clean.clustermessage DEBUG HIDDEN_USER 584x4918x1 - 212.112.118.110,10.61.17.5 /rest/insight/1.0/user/got/message/rlabs.insight.i18n.dc.clean.clustermessage [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894296172} to cache replication queues: 1...2023-09-28 09:44:56,196+0000 http-nio-8080-exec-2 url: /rest/insight/1.0/user/got/message/rlabs.insight.i18n.dc.clean.clustermessage DEBUG HIDDEN_USER 584x4918x1 - 212.112.118.110,10.61.17.5 /rest/insight/1.0/user/got/message/rlabs.insight.i18n.dc.clean.clustermessage [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894296172} to cache replication queues: 1.2023-09-28 09:44:56,266+0000 http-nio-8080-exec-11 url: /rest/plugins/1.0/notifications/JIRAUSER12801 DEBUG HIDDEN_USER 584x4919x1 - 212.112.118.110,10.61.17.5 /rest/plugins/1.0/notifications/JIRAUSER12801 [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894296266} to cache replication queues: 1...2023-09-28 09:44:56,269+0000 http-nio-8080-exec-11 url: /rest/plugins/1.0/notifications/JIRAUSER12801 DEBUG HIDDEN_USER 584x4919x1 - 212.112.118.110,10.61.17.5 /rest/plugins/1.0/notifications/JIRAUSER12801 [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894296266} to cache replication queues: 1.2023-09-28 09:44:56,349+0000 RMI TCP Connection(21)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache UserPropertyManager.ApplicationUser.cache: remote remove received for key: CacheKey[entityName=ApplicationUser,entityId=12801]2023-09-28 09:44:56,356+0000 RMI TCP Connection(21)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache UserPropertyManager.ApplicationUser.cache: remote remove received for key: CacheKey[entityName=ApplicationUser,entityId=12801]2023-09-28 09:44:56,675+0000 http-nio-8080-exec-9 url: /rest/atlassian-cluster-monitoring/cluster/suppliers/data/com.atlassian.cluster.monitoring.cluster-monitoring-plugin/runtime-information/service-desk-0 DEBUG HIDDEN_USER 584x4924x3 - 212.112.118.110,10.61.17.5 /rest/atlassian-cluster-monitoring/cluster/suppliers/data/com.atlassian.cluster.monitoring.cluster-monitoring-plugin/runtime-information/service-desk-0 [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894296669} to cache replication queues: 1...2023-09-28 09:44:56,679+0000 http-nio-8080-exec-9 url: /rest/atlassian-cluster-monitoring/cluster/suppliers/data/com.atlassian.cluster.monitoring.cluster-monitoring-plugin/runtime-information/service-desk-0 DEBUG HIDDEN_USER 584x4924x3 - 212.112.118.110,10.61.17.5 /rest/atlassian-cluster-monitoring/cluster/suppliers/data/com.atlassian.cluster.monitoring.cluster-monitoring-plugin/runtime-information/service-desk-0 [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894296669} to cache replication queues: 1.2023-09-28 09:44:56,710+0000 http-nio-8080-exec-14 url: /rest/atlassian-cluster-monitoring/cluster/suppliers/data/com.atlassian.cluster.monitoring.cluster-monitoring-plugin/runtime-information/service-desk-1 DEBUG HIDDEN_USER 584x4923x2 - 212.112.118.110,10.61.17.5 /rest/atlassian-cluster-monitoring/cluster/suppliers/data/com.atlassian.cluster.monitoring.cluster-monitoring-plugin/runtime-information/service-desk-1 [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894296710} to cache replication queues: 1...2023-09-28 09:44:56,723+0000 http-nio-8080-exec-14 url: /rest/atlassian-cluster-monitoring/cluster/suppliers/data/com.atlassian.cluster.monitoring.cluster-monitoring-plugin/runtime-information/service-desk-1 DEBUG HIDDEN_USER 584x4923x2 - 212.112.118.110,10.61.17.5 /rest/atlassian-cluster-monitoring/cluster/suppliers/data/com.atlassian.cluster.monitoring.cluster-monitoring-plugin/runtime-information/service-desk-1 [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894296710} to cache replication queues: 1.2023-09-28 09:44:57,233+0000 http-nio-8080-exec-7 url: /rest/api/2/status DEBUG HIDDEN_USER 584x4926x1 - 212.112.118.110,10.61.17.5 /rest/api/2/status [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894297233} to cache replication queues: 1...2023-09-28 09:44:57,237+0000 http-nio-8080-exec-7 url: /rest/api/2/status DEBUG HIDDEN_USER 584x4926x1 - 212.112.118.110,10.61.17.5 /rest/api/2/status [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894297233} to cache replication queues: 1.2023-09-28 09:44:57,588+0000 RMI TCP Connection(21)-10.61.17.56 DEBUG [c.a.j.c.d.l.rmi.ehcache.RMICachePeer] RMICachePeer for cache UserPropertyManager.ApplicationUser.cache: remote remove received for key: CacheKey[entityName=ApplicationUser,entityId=12801]2023-09-28 09:45:01,625+0000 http-nio-8080-exec-18 url: /rest/wrm/2.0/resources DEBUG HIDDEN_USER 585x4931x1 - 212.112.118.110,10.61.17.5 /rest/wrm/2.0/resources [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] About to add localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894301625} to cache replication queues: 1...2023-09-28 09:45:01,628+0000 http-nio-8080-exec-18 url: /rest/wrm/2.0/resources DEBUG HIDDEN_USER 585x4931x1 - 212.112.118.110,10.61.17.5 /rest/wrm/2.0/resources [c.a.j.c.distribution.localq.LocalQCacheManager] [LOCALQ] [VIA-INVALIDATION] Done adding localQCacheOp: LocalQCacheOp{cacheName='UserPropertyManager.ApplicationUser.cache', action=REMOVE, key=CacheKey[entityName=ApplicationUser,entityId=12801], value == null ? true, replicatePutsViaCopy=false, creationTimeInMillis=1695894301625} to cache replication queues: 1.It looks like there is not fatal errors
I have turned on debug mode for following and turned off others.Almost full log can be found here https://pastebin.com/raw/L9ZxY1Yb
It looks like you're new here. Sign in or register to get started.
![Photo of Sayed Bares [ServiceRocket]](https://us.v-cdn.net/6038660/uploads/avatars/52/66/n5266535d2887d4720139fb3968df272a.png)
