nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

How to temporaly silent opsgenie notifications?

Daniel Leite

With the recent cloudflare network problem, our sites went down. Of course, opsgenie received alerts form several systems and kept beeping and showing up notifications for all of then.

So the question is how to silent all notifications for X minutes, when we know already about the problem or a service is flapping.

They should still show in the site/app, but just do not show notification nor alerts... and of course, after the X minuted, any new alert should send notification again

Thanks for the help

Accepted answers

Nick Haller

Hi Daniel,

Thanks for reaching out. I think your best bet for this scenario would be a Maintenance Policy which allows you to enable or disable multiple policies/integrations with a single entry during a specified window.

If you would like the alerts created in your Opsgenie account, but notifications delayed/suppressed - you'll want this Maintenance window to enable a Notification Policy. If you would like the alerts to NOT be created you will want to disable an integration - obviously if an alert isn't created, no user(s) will be notified.

Both the Notification and Maintenance policies can be set on the team level under the Policies tab. If you were to lean towards enabling/disabling a Notification policy, you will first want to create this.

Within the filters of the Notification policy - you can select ALL alerts to be delayed/suppressed, or get more granular with the conditions only looking for cloudflare alerts:

Screen Shot 2019-07-02 at 5.08.02 PM.png

Once this Notification policy is configured, you will now be able to search for and enable it during the Maintenance window. Within a Maintenance policy, specify the timeframe and the Notification policy.

Screen Shot 2019-07-02 at 5.11.56 PM.png

If you were to lean the other route of either enabling/disabling an integration and avoid any alert creation during this window - you'd simply want to adjust the filter of the Maintenance policy:

Screen Shot 2019-07-02 at 5.20.41 PM.png

You can also select the + Add rule button in the Maintenance policy to enable or disable multiple policies/integrations.

Best,

Nick

All comments

Nick Haller

Hi Daniel,

Within the filters of the Notification policy - you can select ALL alerts to be delayed/suppressed, or get more granular with the conditions only looking for cloudflare alerts:

Screen Shot 2019-07-02 at 5.08.02 PM.png

Screen Shot 2019-07-02 at 5.11.56 PM.png

If you were to lean the other route of either enabling/disabling an integration and avoid any alert creation during this window - you'd simply want to adjust the filter of the Maintenance policy:

Screen Shot 2019-07-02 at 5.20.41 PM.png

You can also select the + Add rule button in the Maintenance policy to enable or disable multiple policies/integrations.

Best,

Nick

Daniel Leite

While not very friendly way to do this, this do work!

it is not very friendly because it is way too complex and requires multiple steps, most of our team do not know opsgenie well enough to even know how this setting work. But the worse is that requires a user with enough permissions to build and enable those settings, so at least it requires a escalation to the next level to be able to create those emergency maintenance settings.

A better option would be a user "silent/auto-ack all for..." x minutes, next to the "ack all, close all"

It would be something that would not be used normally, but very useful to silent a alert spike, giving the team time to work in the problem and not in the never ending alert flood

maybe i need to create a feature request... (but how to do it ! )

Nick Haller

Hi Daniel - thanks for the feedback. You can alternatively suppress the notifications of an integration (found under Settings -> Configured integrations OR a team's Integration tab) - but will need to remember to turn this option back on after the fact:

suppress image.jpg

Carlos Reyes

Is there a way to have a recurring Maintenance window?

We have some nightly tasks that generate alerts..

I cant find a way to have a nightly maintenance window say 21:00 to 21:15

Any tips?

unknown

Wondering if this is the same issue my team has been trying to iron out for the last few weeks- we have an email integration that creates alerts for incoming emails from QRadar for one of our clients that we want to suppress during hours that we do not provide support for the client. Here's the notification policy that we created under the team that gets those alerts. Problem is, it doesn't appear to have any effect at all:

OG Notification Policy.png

Nick Haller

Hi @[deleted],

If this notification policy is consistent, and should always apply M-F 07:30-16:30, then I don't think enabling this via a maintenance policy is needed. You should be able to simply just keep the notification policy enabled at all times.

Regardless, what exactly is not working as expected? Is the notification policy not silencing these alerts during those days / hours? You may want to check your regex is correct as well. I typically use something like this: https://regex101.com/

It's also important to note that the hours defined in notification policies are applied to the account's timezone. So if your personal timezone varies, then that might be an issue: https://support.atlassian.com/opsgenie/docs/time-constraints-and-timezones/

Hope that helps.

Nick Haller

Feel free to also open a ticket with our support team here: https://support.atlassian.com/opsgenie/

I noticed you blurred some of the above screenshot so if you needed to keep this private, we can take a look at things behind the scenes.

unknown

That was quick! Yeah, I originally had it set up without the maintenance policy- just getting desperate and trying different things at this point. The regex should work- it's using the same exact phrase that we use for the integration, which works fine (it's just the name of our client-hence the blurring). Basically, the problem is that we're still getting alerts during those "alert suppression" hours for alerts with those tags. The alerts are never suppressed during any hours for any time zone. It's like it just doesn't work. I have the right team, the right tag, the right hours, etc., and we're still getting alerts all hours of the day.

Bruno Araújo_cdn78n

Is it possible to achieve this without using policies?

Welcome!

It looks like you're new here. Sign in or register to get started.

Quick Links

Find more posts tagged with

opsgenie