looking for CD/CI solutions for testing firmware on physical hardware

Question

Currently using bitbucket webhooks with Jenkins controller-agent framework to test firmware, which is working well but looking for a more modern, integrated and secure solution. From what I've read, the bitbucket pipelines functionality is more catered for cloud testing services.

For more of an understanding of what I'm trying to achieve:

[push / pull-request] -> [repo cloned to a local machine] -> [testing firmware on physical device] -> [test results available on bitbucket pipelines]

These firmware tests could take longer than 120 mins therefore self hosted runners are not an option.

Any suggestions are greatly appreciated.

Theodora Boudale · Accepted Answer

Hi Josiah and welcome to the community.

Having the test results available on the Bitbucket Pipelines page is only possible with Pipelines that run in our own infrastructure or with Pipelines runners (in your own infrastructure).

We have a feature request for the ability to extend the execution time beyond 120 mins for self-hosted runners:

* https://jira.atlassian.com/browse/BCLOUD-21615

If this is something you'd be interested in, I would suggest adding your vote to the feature request (by selecting the Vote for this issue link) as the number of votes helps the development team and product managers better understand the demand for new features. You are more than welcome to leave any feedback, and you can also add yourself as a watcher (by selecting the Start watching this issue link) if you'd like to get notified via email on updates.

I also wanted to mention that the 120 mins limit applies to each step of the pipeline and not to the whole build. In case you're running e.g. 5 commands and each of them completes in less than 120 minutes, you could divide them into separate (possibly parallel) steps with a runner.

Kind regards,
Theodora