Notification when webhook fails

[Moses Moore]

Over the weekend, some teammates were annoyed that something failed in production but they didn't receive notice (before a user told them).  The alerts did land on OpsGenie, but didn't go further.  Checking the activity log I found this system message:

Could not send [Create] action to Mattermost [If severity > P3]. Reason: 403 Forbidden: "{"id":"web.incoming_webhook.permissions.app_error","message":"Inappropriate channel permissions.","detailed_error":"","request_id":"[redacted]","status_code":403}"

I'd really rather not examine by hand every single alert every hour of the day to make certain they successfully used their webhooks.  How can I get notification that a webhook failed?  Even an report I can fetch from the OpsGenie website for a list of failed notifications with what/how/who would be somewhat adequate.

[John M]

Hi @Moses Moore ,

At the moment, the only way to get notification based on logged event triggers would be to use a Splunk integration: 

https://support.atlassian.com/opsgenie/docs/integrate-opsgenie-with-splunk/

We do have a logs API but I don't think it's going to provide what you're looking for.