Xray: Custom test issue workflow statuses not being disallowed from being added to execution

[Jack Koval]

I've created a new workflow for the test issue type in a project on Jira Cloud:

Draft, In Review, Ready to Run and Obsolete.

I've also added Draft, In Review and Obsolete into the option "Disallow executions of Tests with workflow statuses". 

However Test Executions in the project with this workflow still happily accept tests in any workflow state.

Is there something I've missed or is something broken?

[Mercy]

In Xray Cloud, the “Disallow executions of Tests with workflow statuses” setting only applies to Test issues that use the default Xray Test Workflow Scheme or workflows mapped to the Test issue type through the Xray App configuration, not to any custom workflow you create directly in Jira. When you add custom statuses to your own workflow, Xray doesn’t automatically recognize them unless the workflow is registered under Project Settings → Xray Settings → Test Workflow. That’s where Xray evaluates which statuses should block a Test from being added to a Test Execution.