I am constantly being slowed down in my work by having to revert changes made by this tool - for example, page titles in Confluence conform to a very consistent standard for traceability / audit purposes.
They cannot be summarised or changed - in fact, it would be an ideal thing for an LLM to do as it's not complex. Instead I get a frequently incorrect summary. Fine. It's 'AI'.
I can't disable it as it's used by others for things LLMs are good for (i.e. if you don't know JQL) - so I provide some explicit instructions when interacting with my Atlassian Account. For example 'Never update or add a title to a page I am working on'.
They are ignored.
When probed the tool explained that my rules are being superseded by system or developer ones, and with a very small amount of basic prompting I was able to retrieve it's system prompts and the names of Atlassian’s' internal tools used by these agents (despite there being an explicit prompt stating not to do this - so it's not just me it ignores).
I'm not going to share the transcript of this conversation here, but based on the rules Atlassian have defined, and the fact they've been broken makes me very concerned about the safety of this tool - does it actually have any guardrails? Would it respect them?
I've had these tools described as a very new intern - competent but inexperienced. This one is verging on obliviously malicious.
It's not winning hearts and minds - this was meant to help, not