Autogen tool for pipeline.yml

[Mike Burton]

We have about 400 end to end tests that take just over an hour to run, and they can fail for reasons other than functional failure, even with retries. I'd like to give our build runners the option to rerun only the failed tests, but writing a 400-step pipeline against 20 possible environments will be problematic and nigh-impossible to maintain manually.  

I'm thinking I could write an autogen tool to recreate the pipeline for each build, but it occurs to me that this could be something that already exists in whole or in part. Has anyone else found and worked with something like that?

[Alex Tran · Accepted solution]

I reckon you might consider a simpler solution, for e.g.

- use after_script to collect the failed tests and then via pipeline API trigger another (or the same) pipeline to run those failed tests again.

(https://confluence.atlassian.com/bitbucket/configure-bitbucket-pipelines-yml-792298910.html#Configurebitbucket-pipelines.yml-afterscript)

- you may need a persistent store somewhere to track states (e.g. list of failed tests, retry count, etc.)

[Mike Burton]

I'm gonna give this a go, thank you!