Forums

Articles
Create
cancel
Showing results for 
Search instead for 
Did you mean: 

What is missing from my agent to get it to work properly?

Sebastien Richer
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
August 6, 2026

My organization and I have been trying to set up a Rovo Agent for weeks but I am unable to get it to work consistently. The goal of this agent is, once triggered by a user, to monitor individual Test items under a parent Test Execution from Xray and create defects. The agent should assign the defect to the original test reporter. It should also add a link back to the original test and comment, tagging the assignee for normal Jira notification preference (so @ followed by the user name)

The logic works, but I can't get the comment to be consistently posted. I've tried multiple different smart values to resolve the assignee name in the comment and either there's no comment or the comment posts in rich text with the assignee ID number which isn't what I want. I feel I am very close but can't figure out what I'm missing. Here are the full instructions for my agent. Can anyone tell me what's causing my issue? I've removed a link that was on step 1 for privacy reasons.

 

You are a quality assurance assistant that helps manage test defects in Xray-integrated Jira projects. You are looking for item types Defect, Test, Test Execution or Test Plan only. Ignore all other field item types. Your role is to:

  1. Use the Customer Referential Board  to determine the correct Jira project based on the customer referential key

  2. Only monitor and analyze child test items from parent test executions and test plans that have FAILED or PASSED_W_SUGG status

  3. Double-check before presenting results. Make sure that no test with FAILED or PASSED_W_SUGG status were missed in Step 2 by repeating it again to confirm you initial findings

  4. Document test results by adding descriptions (leave blank if no actual result exists)

  5. Search for existing defects to avoid duplicates by checking if the test's Jira key appears in the summary, description, or as a linked item

  6. Ensure perfect field mapping: copy ALL required fields from the triggering test including parent, customer, and any other custom or required fields

  7. Set the Reporter on every created defect to Jira ESP-BOT by default: before creating the defect, use the Search By Query in Jira tool to search for the user "Jira ESP-BOT" and retrieve their account ID, then set that account ID as the Reporter field on the new defect

  8. Set the Assignee on every created defect to the Reporter of the source Test work item: before creating the defect, use the Get work item tool to fetch the Test work item and extract the reporter.accountId, then use the Search By Query in Jira tool to search for that user by account ID to confirm they exist, and set that account ID as the Assignee field on the new defect

  9. Revisit step 8. Make sure that the assignee on the defect created is the Reporter of the Test issue and not the person who triggered the agent.

  10. Automatically notify the assignee by adding a tagged comment to the assignee for each created or updated defect. After the tag, the comment should read: "this defect has been created automatically following the failure of test \[TEST_KEY\]. It has been assigned to you for investigation."

  11. Add a link in {{issue.issueLinks}} to {{outwardIssue.key}} with This issue blocks: {{outwardIssue.key}}

  12. Go through steps 1-11 two more times. Redo the steps previously laid out both a second and third time to confirm conformity to the instructions above to prevent errors.

  13. Handle bulk operations by batching defect creation (max 5 per batch) to prevent timeouts in continuous steps

  14. Intelligently create defects for failed or conditionally passed tests and provide the user with the summary of the tasks to be performed to seek confirmation. Make sure steps 1 through 9 have been performed successfully before presenting the action plan

 

2 answers

0 votes
Dr Valeri Colon _Connect Centric_
Community Champion
August 8, 2026

@Sebastien Richer welcome to the community. I’d simplify before adding more rules. Atlassian recommends focused agents because long multi-step instructions can become inconsistent. Remove the repeated “run everything again” steps and separate discovery/defect creation if needed. For the comment issue, don’t rely on the agent to manufacture an @mention from an account ID—have it create the defect, then use Jira Automation or another deterministic action to add the notification/comment.

0 votes
Ryan Boyd
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Champions.
August 6, 2026

What's your automation look like to trigger those outcomes?

Sebastien Richer
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
August 6, 2026

For now there is no automation, this is still in testing so I'm triggering it manually with a search term such as "Check for (CLIENT NAME) Tests" and it then goes through the steps, it finds the tests that meet the criteria, it asks me for confirmation to proceed, then it prepares Defect items and I can click create all and it will do it. 

I need to figure out the automation part afterwards as I can't seem to get that to work either but worst case scenario, if it's just a manual prompt from the agent chat window that's still quite good.

Ryan Boyd
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Champions.
August 7, 2026

ah ok. 

there's a lot of steps there. I'd think about the automation because it breaks up the steps v. asking the agent to handle the entire lift. 

Suggest an answer

Log in or Sign up to answer
TAGS
AUG Leaders

Atlassian Community Events