Testing the Bitbucket performance testing scripts on Single Node BBDC instance without NFS server

[Suman]

We have set up a single node BBDC instance on our DEV environment to test the Bitbucket performance scripts provided in below link.
https://bitbucket.org/atlassian/elastic-experiment-executor\\ 
While testing the scripts we are using "Bring your own infrastructure" approach as we would like to test this only on a single Node BBDC without NFS server. We are facing an issue while trying to execute the Run.py script. We followed the mentioned steps and created respective json files which mentions the BBDC node and worker node. Still we are facing below error while executing Run.py. Could you please let us know if the error is related to some python modules missing or an error related to BBDC node and worker JSON files which are used to execute these tests on. We can see in error that the server from where the scripts are being run is trying to poll the worker node  on port 6373. Do we need to enable any service to be run on this port? 

Error: 

er-nodes: 1, clients-per-worker: 40, duration 10000 ms
2018-08-03 06:58:35,348 - RunThread:1 - INFO - Sanitizing workers
2018-08-03 06:58:35,873 - RunThread:1 - INFO - Resetting Bitbucket for next stage
2018-08-03 06:58:36,090 - RunThread:1 - INFO - Sleeping for two minutes to allow bitbucket server time to restart
2018-08-03 07:00:36,096 - RunThread:1 - INFO - Distributing grinder to workers
2018-08-03 07:00:37,778 - RunThread:1 - INFO - Starting grinder console on node e3-user@172.29.4.214
2018-08-03 07:00:37,793 - RunThread:1 - INFO - Polling url: http://172.29.4.214:6373/version\\ 2018-08-03 07:10:38,001 - RunThread:1 - WARNING - Timed out polling for response from http://172.29.4.214:6373/version\\ 2018-08-03 07:10:38,001 - RunThread:1 - INFO - Starting grinder agents on workers
2018-08-03 07:10:38,017 - RunThread:1 - INFO - Polling url: http://172.29.4.214:6373/agents/status\\ 2018-08-03 07:20:39,000 - RunThread:1 - WARNING - Timed out polling for response from http://172.29.4.214:6373/agents/status\\2018-08-03 07:20:39,000 - RunThread:1 - INFO - Beginning execution of load (my-experiment/stage-000)
Exception in thread RunThread:1:
Traceback (most recent call last):
File "/usr/lib64/python2.7/threading.py", line 804, in __bootstrap_inner
self.run()
File "./Run.py", line 130, in run
self.run_stage(self._thread, stage)
File "./Run.py", line 150, in run_stage
self.start_stage(worker_stage)
File "./Run.py", line 331, in start_stage
headers={"Content-Type": "application/json"})
File "/home/ec2-user/.local/lib/python2.7/site-packages/requests/api.py", line 110, in post
return request('post', url, data=data, json=json, **kwargs)
File "/home/ec2-user/.local/lib/python2.7/site-packages/requests/api.py", line 56, in request
return session.request(method=method, url=url, **kwargs)
File "/home/ec2-user/.local/lib/python2.7/site-packages/requests/sessions.py", line 488, in request
resp = self.send(prep, **send_kwargs)
File "/home/ec2-user/.local/lib/python2.7/site-packages/requests/sessions.py", line 609, in send
r = adapter.send(request, **kwargs)
File "/home/ec2-user/.local/lib/python2.7/site-packages/requests/adapters.py", line 487, in send
raise ConnectionError(e, request=request)
ConnectionError: HTTPConnectionPool(host='172.29.4.214', port=6373): Max retries exceeded with url: /agents/start-workers (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f9d79116050>: Failed to establish a new connection: [Errno 111] Connection refused',))

[Adrian Moerchen]

Solution:

• rsync was missing on the worker nodes (apt-get install rsync)

Same here, only with Confluence.

2019-10-16 13:55:15,755 - RunThread:1 - INFO - Polling url: http://cf-data-center-tests-worker-1:6373/version
2019-10-16 14:05:17,461 - RunThread:1 - WARNING - Timed out polling for response from http://cf-data-center-tests-worker-1:6373/version

[Sapan_T]

@Suman and @Adrian Moerchen 

Were you able to run this script successfully on your infrastructure?

If yes, I need some information please on what all changes are required. We are trying to setup BBDC on a 2 node cluster.

Thank you!

[Adrian Moerchen]

@Sapan_T  Not really, the old scripts need old Linux ...

You should go with the newer scripts: https://github.com/atlassian/dc-app-performance-toolkit.

(Hint: if you are using Windows: Setup WSL (even WSL 1) and install the scripts within Ubuntu. Installing it directly under Windows is way more harder)

But we're also not finally successfully runing the scripts... and currently doing two things: trying to get the "base" tests runnung and getting our own scripts recording performance data.