Having issues with running/operating confluence in clustered mode.
Running with Bigbang, istio is the service mesh, and metallb is the load balancer
Helm Chart Version: 1.13.0
Confluence Application Version: 7.19.9
Helm chart values:
values:
image:
repository: docker.io/atlassian/confluence
serviceAccount:
clusterRole:
create: true
clusterRoleBinding:
create: true
confluence:
additionalEnvironmentVariables:
- name: ATL_FORCE_CFG_UPDATE
value: "true"
- name: "http_proxy"
value: "REDACTED"
- name: "https_proxy"
value: "REDACTED"
- name: "no_proxy"
value: "REDACTED"
clustering:
enabled: true
forceConfiguration: true
additionalJvmArgs:
- -Dcom.redhat.fips=false
- -Djava.net.preferIPv4Stack=true
- -Datlassian.dev.mode=false
- -Datlassian.plugins.enable.wait=300
podAnnotations:
traffic.sidecar.istio.io/excludeOutboundPorts: "80,443,5701"
volumes:
localHome:
persistentVolumeClaim:
create: true
resources:
requests:
storage: 2Gi
mountPath: "/var/atlassian/application-data/confluence"
sharedHome:
nfsPermissionFixer:
imageRepo: docker.io/library/alpine
imageTag: 3.18.2
persistentVolumeClaim:
storageClassName: ceph-filesystem
create: true
resources:
requests:
storage: 2Gi
mountPath: "/var/atlassian/application-data/shared-home"
My initial pod comes up fine. I can step through the setup process, and login as the admin account. And I can see the first node under Clustering.
However when I scale up replicas to 2 nodes. The next pod hangs, and is unable to start the bootstrap with a null pointer exception:
ERROR [Catalina-utility-1] [atlassian.confluence.setup.ConfluenceConfigurationListener] contextInitialized An error was encountered while bootstrapping Confluence (see below):
null
java.lang.NullPointerException
at java.base/java.lang.Class.forName0(Native Method)
at java.base/java.lang.Class.forName(Class.java:315)
at com.atlassian.confluence.impl.util.db.SingleConnectionDatabaseHelper.getConnection(SingleConnectionDatabaseHelper.java:41)
at com.atlassian.confluence.impl.setup.DefaultBootstrapDatabaseAccessor.getBootstrapData(DefaultBootstrapDatabaseAccessor.java:46)
at com.atlassian.confluence.setup.DefaultBootstrapManager.afterConfigurationLoaded(DefaultBootstrapManager.java:872)
at com.atlassian.config.bootstrap.DefaultAtlassianBootstrapManager.init(DefaultAtlassianBootstrapManager.java:69)
at com.atlassian.confluence.setup.DefaultBootstrapManager.init(DefaultBootstrapManager.java:236)
at com.atlassian.config.util.BootstrapUtils.init(BootstrapUtils.java:34)
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.initialiseBootstrapContext(ConfluenceConfigurationListener.java:145)
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.contextInitialized(ConfluenceConfigurationListener.java:63)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4491)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4939)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.base/java.lang.Thread.run(Thread.java:829)
2023-10-31 18:36:05,708 WARN [Catalina-utility-1] [atlassian.confluence.plugin.PluginFrameworkContextListener] contextInitialized Not starting full plugin system due to upgrade
2023-10-31 18:36:05,716 [Catalina-utility-1]
[Filter: profiling] defaulting to off [autostart=false]
2023-10-31 18:36:06,382 INFO [Catalina-utility-1] [com.atlassian.confluence.lifecycle] init Confluence is ready to serve
31-Oct-2023 18:36:06.396 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8090"]
31-Oct-2023 18:36:06.415 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [7960] milliseconds
2023-10-31 18:36:07,859 ERROR [http-nio-8090-exec-1] [atlassian.confluence.util.AbstractBootstrapHotSwappingFilter] doFilter Could not get swap target filter
I have even tried an alternative setup, where I scale the pods before running setup.
If I do this, then all the pods stand up with no errors.
I can step through the setup process, however when I check "Clusters" it shows only 1 node. Additionally, If I scale back down to 0, and then scale back up to 1 or more.
Then all my confluence pods run into the null pointer exception during bootstrapping.
