Disaster Recovery Exercise 1

We successfully finished yesterday's disaster recovery exercise.

The first switch to the secondary data center was completed with less than 20 minutes of downtime. The simulated failure of our primary data center occurred at 20:39:25 UTC, and all systems were back up and running in our secondary data center at 20:58:07 UTC.

As this process was on the lower end of the expected unavailability duration, we decided to switch back to the primary data center within the same maintenance window. This eliminated the need for the second maintenance window, scheduled for the next day.

The complete switch back to the primary data center was completed after less than 15 minutes of downtime. The simulated failure of our secondary data center occurred at 21:46:11 UTC, and all systems were back up and running in our primary data center at 22:00:16 UTC.

We would like to thank you for your understanding for this exercise and the associated periods of unavailability.

All systems are back online since 22:02 UTC and we are monitoring the situation. We will publish a follow-up report tomorrow.

We will also use this maintenance window to switch back to the primary data center. This will make the maintenance window tomorrow unnecessary, but it will cause some downtime in the next minutes.

Our system are back up and running in the secondary data center.

The disaster recovery exercise has started and as expected our system are experiencing some downtime while we are switching over to our secondary data center. We will update you as soon as we have new information.

The scheduled maintenance is now underway. We'll keep you updated on our progress.

We will run our procedures for the case of the catastrophic failure of our main data center and will switch over to our disaster recovery data center in a another geographic region. During the switchover our systems might not be available for up to one hour. Based on past performance we expect a downtime of around 45 minutes.