We maintain an always on bug bounty to identify and triage issues in our products and services. Many customers ask us for ‘penetration reports’ or similar - basically a report from a third-party that shows that we are testing the security of our own products and services.
We believe our always-on bug bounty, with more than 1200+ security researchers (think : extension of our own team) provides better value than a couple of people for a week or two. We also recently published our thinking on the differences in penetration tests versus vulnerability assessments versus a bug bounty program on our Approach to Security Testing page on our external website.
Once a quarter, we publish a roll-up report from each of our Bug Bounty programs to give our customers a view on progress of the program and the vulnerabilities. For many customers, these reports can take the place of a penetration test report, and shows that we are actively managing and closing any security issues that are in our products or services.
Stats for the Quarter
In the October 2021 to December 2021 quarter, we had 187 individual security researchers contribute to our bug bounty program, submitting a total of 930 bugs for review, with a total of 309 valid bugs, which is an average of ~21.5% valid bug to noise ratio (with a low of 2% valid bug to noise ratio in our Opsgenie program and a high of 44% valid bug to noise ratio in our Trello program) across our four independent bug bounty programs. In the July 2021 to September 2021 quarter, there were a total of 65 working days (excluding weekends and holidays), which means we had 2.87 additional security researchers testing our Products and Services per day.
Compared to the July to September 2021 quarter, we had 26% fewer security researchers, 6% more bugs submitted for review, and 1% more valid bugs, with a lower bug to noise ratio by ~18%.
Get the Reports
If you have customers asking for a penetration test report, point them out to the Approach to Security Testing page, where (down at the bottom) we have published reports for Atlassian (including Jira, Confluence, Bitbucket and more), Statuspage, Trello and Opsgenie. We have also published the same links to the Security Testing section of our Security Practices page.
Download current test reports
These reports show the progress of our bug bounties for the October 2021 to December 2021 quarter. Any security vulnerabilities identified in the reports below are tracked in our internal Jira as they come through the Bug Bounty intake process and are closed according to the SLA timelines on our Security Bug Fix Policy.
Bill Marriott
Trust & Security
Atlassian
Sydney
4 accepted answers
0 comments