Performance testing of Jira, Confluence and Bitbucket with dc_app_performance_toolkit Part6

[#1]

Part 5

bzt.log

This file contains information which you can see in the terminal while running tests:

[2020-07-24 14:32:11,645 INFO root] Taurus CLI Tool v1.14.2
[2020-07-24 14:32:11,646 DEBUG root] Command-line options: {'log': '/var/folders/4r/w8hkd4w51x787tw4ynb29v2w0000gn/T/bzt_deodyr86.log', 'option': None, 'quiet': None, 'verbose': None, 'no_system_configs': None, 'aliases': []}
[2020-07-24 14:32:11,646 DEBUG root] Python: CPython 3.8.5
[2020-07-24 14:32:11,646 DEBUG root] OS: uname_result(system='Darwin', node='Alexeys-MacBook-Pro-2.local', release='19.6.0', version='Darwin Kernel Version 19.6.0: Sun Jul  5 00:43:10 PDT 2020; root:xnu-6153.141.1~9/RELEASE_X86_64', machine='x86_64', processor='i386')
[2020-07-24 14:32:11,646 INFO root] Starting with configs: ['confluence.yml']
[2020-07-24 14:32:11,649 DEBUG root] Using personal config: /Users/alexm/.bzt-rc
[2020-07-24 14:32:11,649 INFO Engine] Configuring...
[2020-07-24 14:32:11,718 DEBUG Engine] Base configs list: ['/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/venv/lib/python3.8/site-packages/bzt/resources/10-base-config.yml']
[2020-07-24 14:32:11,719 DEBUG Engine.Configuration] Configs: ['/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/venv/lib/python3.8/site-packages/bzt/resources/10-base-config.yml']
[2020-07-24 14:32:11,719 DEBUG Engine.Configuration] Reading /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/venv/lib/python3.8/site-packages/bzt/resources/10-base-config.yml as YAML
[2020-07-24 14:32:11,742 DEBUG Engine] User configs list: ['/Users/alexm/.bzt-rc', 'confluence.yml']
[2020-07-24 14:32:11,742 DEBUG Engine.Configuration] Configs: ['/Users/alexm/.bzt-rc', 'confluence.yml']
[2020-07-24 14:32:11,743 DEBUG Engine.Configuration] Reading /Users/alexm/.bzt-rc as YAML
[2020-07-24 14:32:11,747 DEBUG Engine.Configuration] Reading confluence.yml as YAML
[2020-07-24 14:32:11,762 DEBUG Engine.Configuration] Configs: ['/Users/alexm/.bzt-rc', 'confluence.yml']
[2020-07-24 14:32:11,762 DEBUG Engine.Configuration] Reading /Users/alexm/.bzt-rc as YAML
[2020-07-24 14:32:11,766 DEBUG Engine.Configuration] Reading confluence.yml as YAML
[2020-07-24 14:32:11,781 DEBUG Engine] Requesting updates info: https://gettaurus.org/updates/?version=1.14.2&installID=macos-acde48001122
[2020-07-24 14:32:11,781 DEBUG HTTPClient] Making HTTP request GET https://gettaurus.org/updates/?version=1.14.2&installID=macos-acde48001122
[2020-07-24 14:32:11,781 INFO Engine] Artifacts dir: /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11
[2020-07-24 14:32:11,783 DEBUG Engine] New artifact filename: /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/effective
[2020-07-24 14:32:11,785 DEBUG Engine.Configuration] Dumping YAML config into /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/effective.yml
[2020-07-24 14:32:11,807 DEBUG Engine.Configuration] Dumping JSON config into /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/effective.json
[2020-07-24 14:32:11,808 DEBUG Engine] New artifact filename: /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/merged.yml
[2020-07-24 14:32:11,809 DEBUG Engine.Configuration] Dumping YAML config into /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/merged.yml
[2020-07-24 14:32:11,816 DEBUG Engine] New artifact filename: /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/merged.json
[2020-07-24 14:32:11,817 DEBUG Engine.Configuration] Dumping JSON config into /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/merged.json
[2020-07-24 14:32:11,817 DEBUG Engine] Add existing artifact (move=False): confluence.yml
[2020-07-24 14:32:11,818 DEBUG Engine] Copying confluence.yml to /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/confluence.yml
[2020-07-24 14:32:11,819 DEBUG root] Closing log handler: /var/folders/4r/w8hkd4w51x787tw4ynb29v2w0000gn/T/bzt_deodyr86.log
[2020-07-24 14:32:11,819 DEBUG root] Switched writing logs to /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_14-32-11/bzt.log
[2020-07-24 14:32:11,819 DEBUG root] Linting config
[2020-07-24 14:32:11,823 INFO Engine] Preparing...
........................

If you need to see how the prepare, execute and post run stages went, you should have a look at this file.

confluence.yml

This file is a copy of confluence.yml which you used to run the test with bzt confluence.yml command. It is very convenient to have this file to check which parameters were used for the test.

effective.json/effective.yml

These two files are copies of confluence.yml file in yml and json formats

error.jtl

You can use this file for debugging Jmeter scripts. You can find information on how to do it in the docs/confluence/README.md file.

jmeter.err

Jmeter error log. In my case this file is empty.

jmeter.log

Jmeter log file which contains all log messages sent by Jmeter during test execution:

2020-07-24 15:10:00,962 INFO o.a.j.u.JMeterUtils: Setting Locale to en_RU
2020-07-24 15:10:00,978 INFO o.a.j.JMeter: Loading user properties from: /Users/alexm/.bzt/jmeter-taurus/5.2.1/bin/user.properties
2020-07-24 15:10:00,979 INFO o.a.j.JMeter: Loading system properties from: /Users/alexm/.bzt/jmeter-taurus/5.2.1/bin/system.properties
2020-07-24 15:10:00,979 INFO o.a.j.JMeter: Loading additional properties from: /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_15-07-19/jmeter-bzt.properties
2020-07-24 15:10:00,979 INFO o.a.j.JMeter: Setting System properties from file: /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_15-07-19/system.properties
2020-07-24 15:10:00,980 INFO o.a.j.JMeter: Copyright (c) 1998-2019 The Apache Software Foundation
2020-07-24 15:10:00,980 INFO o.a.j.JMeter: Version 5.2.1
2020-07-24 15:10:00,980 INFO o.a.j.JMeter: java.version=1.8.0_252
2020-07-24 15:10:00,980 INFO o.a.j.JMeter: java.vm.name=OpenJDK 64-Bit Server VM
2020-07-24 15:10:00,980 INFO o.a.j.JMeter: os.name=Mac OS X
2020-07-24 15:10:00,980 INFO o.a.j.JMeter: os.arch=x86_64
2020-07-24 15:10:00,980 INFO o.a.j.JMeter: os.version=10.15.6
2020-07-24 15:10:00,980 INFO o.a.j.JMeter: file.encoding=UTF-8
2020-07-24 15:10:00,981 INFO o.a.j.JMeter: java.awt.headless=true
2020-07-24 15:10:00,981 INFO o.a.j.JMeter: Max memory     =7635730432
2020-07-24 15:10:00,981 INFO o.a.j.JMeter: Available Processors =8
2020-07-24 15:10:00,984 INFO o.a.j.JMeter: Default Locale=English (Russia)
2020-07-24 15:10:00,984 INFO o.a.j.JMeter: JMeter  Locale=English (Russia)
2020-07-24 15:10:00,984 INFO o.a.j.JMeter: JMeterHome=/Users/alexm/.bzt/jmeter-taurus/5.2.1
2020-07-24 15:10:00,984 INFO o.a.j.JMeter: user.dir  =/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app
2020-07-24 15:10:00,984 INFO o.a.j.JMeter: PWD       =/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app
2020-07-24 15:10:05,994 INFO o.a.j.JMeter: IP: 192.168.0.33 Name: Alexeys-MacBook-Pro-2.local FullName: 192.168.0.33
2020-07-24 15:10:05,995 INFO o.a.j.JMeter: user.classpath=/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_15-07-19:/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/jmeter
2020-07-24 15:10:05,995 INFO o.a.j.JMeter: Adding to classpath and loader: /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_15-07-19
2020-07-24 15:10:05,996 INFO o.a.j.JMeter: Adding to classpath and loader: /Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/jmeter
2020-07-24 15:10:06,002 INFO o.a.j.s.FileServer: Default base='/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app'
2020-07-24 15:10:06,006 INFO o.a.j.s.FileServer: Set new base='/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/jmeter'
2020-07-24 15:10:06,118 INFO o.a.j.s.SaveService: Testplan (JMX) version: 2.2. Testlog (JTL) version: 2.2
2020-07-24 15:10:06,126 INFO o.a.j.s.SaveService: Using SaveService properties file encoding UTF-8
2020-07-24 15:10:06,130 INFO o.a.j.s.SaveService: Using SaveService properties version 5.0
................

jmeter-bzt.properties

eter.save.saveservice.autoflush=true
jmeter.save.saveservice.connect_time=true
jmeterengine.force.system.exit=true
summariser.name=
application_hostname=my.domain.io
application_protocol=https
application_port=443
application_postfix=/confluence
total_actions_per_hr=200
perc_view_page=54
perc_view_dashboard=6
perc_view_blog=8
perc_search_cql=7
perc_create_blog=3
perc_create_and_edit_page=6
perc_comment_page=5
perc_view_attachment=3
perc_upload_attachment=5
perc_like_page=3
perc_standalone_extension=0
jmeterengine.nongui.port=4445
jmeterengine.nongui.maxport=4445
jmeter.save.saveservice.timestamp_format=ms
sampleresult.default.encoding=UTF-8
user.classpath=/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/results/confluence/2020-07-24_15-07-19:/Users/alexm/PycharmProjects/easymigration/dc-app-performance-toolkit/app/jmeter

This file contains all parameters with which Jmeter ran during test execution.

kpi.jtl

timeStamp,elapsed,label,responseCode,responseMessage,threadName,success,bytes,grpThreads,allThreads,Latency,Hostname,Connect
1595592651980,13982,jmeter_login_and_view_dashboard,200,"Number of samples in transaction : 8, number of failing samples : 0",Confluence 1-1,true,20910,1,1,0,Alexeys-MacBook-Pro-2.local,0
1595592666301,20109,jmeter_view_page,200,"Number of samples in transaction : 13, number of failing samples : 0",Confluence 1-1,true,34575,1,1,0,Alexeys-MacBook-Pro-2.local,0
1595592686489,983,jmeter_view_page_tree,404,,Confluence 1-1,false,32539,1,1,392,Alexeys-MacBook-Pro-2.local,0
1595592738274,16580,jmeter_view_page,200,"Number of samples in transaction : 13, number of failing samples : 0",Confluence 1-1,true,34564,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592754868,805,jmeter_view_page_tree,404,,Confluence 1-1,false,32539,2,2,411,Alexeys-MacBook-Pro-2.local,0
1595592742430,15346,jmeter_login_and_view_dashboard,200,"Number of samples in transaction : 8, number of failing samples : 0",Confluence 1-2,true,20958,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592774276,36189,jmeter_view_page,200,"Number of samples in transaction : 13, number of failing samples : 0",Confluence 1-1,true,34581,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592810477,30908,jmeter_view_page_tree,Non HTTP response code: java.net.SocketTimeoutException,Non HTTP response message: Read timed out,Confluence 1-1,false,2267,2,2,10712,Alexeys-MacBook-Pro-2.local,590
1595592829809,20611,jmeter_view_page,Non HTTP response code: java.net.SocketTimeoutException,,Confluence 1-2,false,2905,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592841398,20907,jmeter_recently_viewed,Non HTTP response code: java.net.SocketTimeoutException,"Number of samples in transaction : 1, number of failing samples : 1",Confluence 1-1,false,2905,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592862307,19672,jmeter_search_results,200,"Number of samples in transaction : 2, number of failing samples : 0",Confluence 1-1,true,2091,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592850434,32843,jmeter_login_and_view_dashboard,Non HTTP response code: java.net.SocketTimeoutException,"Number of samples in transaction : 8, number of failing samples : 3",Confluence 1-3,false,20394,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592883305,10416,jmeter_login_and_view_dashboard,200,"Number of samples in transaction : 8, number of failing samples : 0",Confluence 1-4,true,20932,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592882057,15549,jmeter_view_page,200,"Number of samples in transaction : 13, number of failing samples : 0",Confluence 1-1,true,34577,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592897621,699,jmeter_view_page_tree,404,,Confluence 1-1,false,32539,2,2,306,Alexeys-MacBook-Pro-2.local,0
1595592898329,3847,jmeter_view_dashboard,200,"Number of samples in transaction : 7, number of failing samples : 0",Confluence 1-1,true,19843,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592902229,16529,jmeter_create_page_editor,404,"Number of samples in transaction : 11, number of failing samples : 1",Confluence 1-1,false,58991,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592918772,8326,jmeter_create_page,200,"Number of samples in transaction : 17, number of failing samples : 0",Confluence 1-1,true,40246,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592927111,4573,jmeter_open_editor,404,"Number of samples in transaction : 9, number of failing samples : 1",Confluence 1-1,false,56905,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592929738,7926,jmeter_view_page,200,"Number of samples in transaction : 13, number of failing samples : 0",Confluence 1-4,true,34561,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592931695,6455,jmeter_edit_page,200,"Number of samples in transaction : 17, number of failing samples : 0",Confluence 1-1,true,40055,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592937682,745,jmeter_view_page_tree,404,,Confluence 1-4,false,32539,2,2,339,Alexeys-MacBook-Pro-2.local,0
1595592938438,942,jmeter_comment,200,"Number of samples in transaction : 1, number of failing samples : 0",Confluence 1-4,true,1316,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592939441,3717,jmeter_upload_attachment,200,"Number of samples in transaction : 1, number of failing samples : 0",Confluence 1-4,true,13991,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592965749,5643,jmeter_view_page,200,"Number of samples in transaction : 13, number of failing samples : 0",Confluence 1-4,true,34558,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592971405,674,jmeter_view_page_tree,404,,Confluence 1-4,false,32539,2,2,270,Alexeys-MacBook-Pro-2.local,0
1595592974241,7707,jmeter_view_page,200,"Number of samples in transaction : 13, number of failing samples : 0",Confluence 1-1,true,34558,2,2,0,Alexeys-MacBook-Pro-2.local,0
1595592981957,649,jmeter_view_page_tree,404,,Confluence 1-1,false,32539,2,2,252,Alexeys-MacBook-Pro-2.local,0
1595593010250,5336,jmeter_view_page,200,"Number of samples in transaction : 13, number of failing samples : 0",Confluence 1-1,true,34576,2,2,0,Alexeys-MacBook-Pro-2.local,0
...............................

Jmeter raw data. This file contains information about requests and responses of JMeter during test run. Later this file will be used by this toolkit to create a summary statistic for the test run.

merged.yml/merged.json

Taurus can be run with multiple configuration files and the merged.json/merged.yml files contain merged data from all these configuration files. In our case merged.json/merged.yml will equal to effective.json/effective.yml.

modified_confluence.jmx

This file contains Jmeter project file with all settings and parameters applied. This file is executed for running Jmeter tests.

pytest.err/pytest.out

Raw files of the pytest engine. Pytest engine is used for Selenium tests.

Part 7