Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

Next challenges

Recent achievements

  • Global
  • Personal

Recognition

  • Give kudos
  • Received
  • Given

Leaderboard

  • Global

Trophy case

Kudos (beta program)

Kudos logo

You've been invited into the Kudos (beta program) private group. Chat with others in the program, or give feedback to Atlassian.

View group

It's not the same without you

Join the community to find out what other Atlassian users are discussing, debating and creating.

Atlassian Community Hero Image Collage
Highlighted

Incident Responders, Incident Commanders, Stakeholders! I want to hear from YOU!

Kate Clavet Atlassian Team Sep 09, 2020

Hello there friendly community! I'm currently working on a guide for folks who are new to Incident Management, or want to improve their current Incident Management process.

The TL;DR 

I'd love to see if you have any nuggets of wisdom to share that I might be able to include in the guide. Your advice would be attributed to you in the form of a quote, even alongside your photo if you like! 

The goal is provide modern IT teams who are looking to start or improve upon an incident management process. 

The whole, detailed story 
If you have something to share, please share it below. If you need ideas, feel free to pick one or two of the below questions or themes to focus on! 

1. While defining your incident management process, what were some key learnings?       What worked/what didn’t?

2. How did you define what constituted an incident versus a notification? Did you find these definitions needed to be fine-tuned over time?

3. How did you define SLAs for different kinds of incidents?

4. How did you assign incident response roles to your team?

5. How did you choose what your “war room” or “command center” would be? (I.e. why did you choose slack versus a phone bridge, etc.)

6. What were the best methods for communicating with stakeholders about incident status? What were the worst?

7. How did you keep responders motivated especially during the postmortem process?

8. How did you report back to C-level stakeholders about the incident response and postmortem process?

9. Overall, what advice would you give to folks just starting an Incident Management process? 

I'll ask you to proof and approve your quote before we publish the guide. All participants will receive a special thank you gift for your participation! 

Looking forward to hearing from you! 

Best,

Kate 

3 comments

 

Off the top of my head, the things I've valued over the last 25 years of handling incidents are:

0. Plan for the disasters. Test the plans. Assume the worst will happen.

1. Have separate people to handle communications. And all communications should say when the next communication will happen

2. Change only one thing at a time

3. Write down everything that you change and the results of the changes

4. Don't Panic!

Hope that's somewhat useful

Like # people like this
Kate Clavet Atlassian Team Sep 09, 2020

This is great! Thanks so much @Matt Doar__ LinkedIn ! 

Take really good notes, try to find out what was happening when the incident happen, from all involved parties/departments even things that seem like they wouldn't be related.  Just put in the notes with a time stamp.  Its interesting what things will just fall out when you get it all on the time line.

Move though the troubleshooting and fix ideas methodically.  Work the easy stuff first. Back out any recent changes,  look over your notes and time line, follow up on all of those items. 

Don't name names. throw blame or call out people on the incident call.  Present the problem, present the symptoms, offer solutions, and be a positive influence.  This is a rough patch for everyone involved. 

If you discover you made the mistake/caused the issue, own up to it.  The problem can then be solutioned instead of everyone still working on what happened. If someone else made the mistake and owns it, don't tease them about it,  that's for in the break room over coffee the next mornings ;)

Like Kate Clavet likes this
Kate Clavet Atlassian Team Sep 10, 2020

Love this! Thanks @Kimberly Deal _Columbus ACE_ 

Only one channel for communicate stakeholders.

Only one source of information and truth.

Let the techs do their incident jobs: respond to managers AND try to fix something will take more time than just working on the problem. 

Dont promise time to restore if its a big issue, or a complex one - if you dont fix in that time, for sure, the pressure will double. Instead, promise communication about status and progress with details enough to let the techs work, and have the stake holders in peace (or less angry....). 

Having a Plan for communication, well knowm, with the reasons why need to be this way would be helpful . 

For me, the user and stakeholders experiences are related to poor communication. 

IT is not good on that one LOL, we need to improve this part (the human one....)

Like Kate Clavet likes this

Comment

Log in or Sign up to comment
TAGS
Community showcase
Published in Opsgenie

Opsgenie and Amazon team up to launch new DevOps Guru integration - now available!

We’re proud to announce that our integration with Amazon DevOps Guru is now live. The Amazon and Opsgenie product teams have worked together to build a deep integration between Opsgenie and the new...

290 views 0 12
Read article

Community Events

Connect with like-minded Atlassian users at free events near you!

Find an event

Connect with like-minded Atlassian users at free events near you!

Unfortunately there are no Community Events near you at the moment.

Host an event

You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events

Events near you