Jira Data Center reindex fails

[Krunal Pandit]

I created Jira datacenter enterprise-scale environment. Followed below link to create data set.

https://developer.atlassian.com/platform/marketplace/dc-apps-performance-toolkit-user-guide-jira/#mainenvironmententerprise

I able to setup Jira and load all data set mentioned in this using step mentioned in link.

There is one step which ask to re-Index Jira once all data is created (Re-indexing Jira Data Center). I am trying to complete that but not able to complete it. Its failing at different percentages.

Searched online for this problem but just found that we need to remove indexes folder from {JIRA_HOME}/caches folder then again do same process but that is also not helpful.

Getting below error logs which found from Jira. In that its mention that it's breaking because of UnknownHost. But that is not case in my scenario as am always connected and system is up and running all time. Even space is also available on instance.

java.net.UnknownHostException: ip-10-0-42-148.us-east-2.compute.internal
com.atlassian.jira.cluster.distribution.localq.LocalQCacheOpSender$UnrecoverableFailure: java.rmi.UnknownHostException: Unknown host: ip-10-0-42-148.us-east-2.compute.internal; nested exception is: 
java.net.UnknownHostException: ip-10-0-42-148.us-east-2.compute.internal
at com.atlassian.jira.cluster.distribution.localq.rmi.LocalQCacheOpRMISender.send(LocalQCacheOpRMISender.java:88)
at com.atlassian.jira.cluster.distribution.localq.LocalQCacheOpReader.run(LocalQCacheOpReader.java:84)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.rmi.UnknownHostException: Unknown host: ip-10-0-42-148.us-east-2.compute.internal; nested exception is: 
java.net.UnknownHostException: ip-10-0-42-148.us-east-2.compute.internal
at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:620)
at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:343)
at com.atlassian.jira.cluster.distribution.localq.rmi.BasicRMICachePeerProvider.lookupRemoteCachePeer(BasicRMICachePeerProvider.java:64)
at com.atlassian.jira.cluster.distribution.localq.rmi.BasicRMICachePeerProvider.create(BasicRMICachePeerProvider.java:39)
at com.atlassian.jira.cluster.distribution.localq.rmi.CachingRMICachePeerManager.getCachePeerFor(CachingRMICachePeerManager.java:58)
at com.atlassian.jira.cluster.distribution.localq.rmi.CachingRMICachePeerManager.withCachePeer(CachingRMICachePeerManager.java:91)
at com.atlassian.jira.cluster.distribution.localq.rmi.LocalQCacheOpRMISender.send(LocalQCacheOpRMISender.java:63)
... 6 more
Caused by: java.net.UnknownHostException: ip-10-0-42-148.us-east-2.compute.internal
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:607)
at net.sf.ehcache.distribution.ConfigurableRMIClientSocketFactory.createSocketWithTimeout(ConfigurableRMIClientSocketFactory.java:97)
at net.sf.ehcache.distribution.ConfigurableRMIClientSocketFactory.createSocket(ConfigurableRMIClientSocketFactory.java:87)
... 15 more

[Krunal Pandit · Accepted solution]

Re-index is failing because its taking more RDS connection which defined in dbconfig.xml for one node. Default pool-max-size is 20 only. I updated it to 50 and after that i executed this and it worked for me.

<pool-max-size>50</pool-max-size>