Disaster Recovery Exercise 1

Tuesday, 21 May 3 hours
Complete
Updated

We successfully finished yesterday's disaster recovery exercise.

The first switch to the secondary data center was completed with less than 20 minutes of downtime. The simulated failure of our primary data center occurred at 20:39:25 UTC, and all systems were back up and running in our secondary data center at 20:58:07 UTC.

As this process was on the lower end of the expected unavailability duration, we decided to switch back to the primary data center within the same maintenance window. This eliminated the need for the second maintenance window, scheduled for the next day.

The complete switch back to the primary data center was completed after less than 15 minutes of downtime. The simulated failure of our secondary data center occurred at 21:46:11 UTC, and all systems were back up and running in our primary data center at 22:00:16 UTC.

We would like to thank you for your understanding for this exercise and the associated periods of unavailability.

Avatar for Christo Karafermanof
Christo Karafermanof
Complete

All systems are back online since 22:02 UTC and we are monitoring the situation. We will publish a follow-up report tomorrow.

Avatar for Christo Karafermanof
Christo Karafermanof
Updated

We will also use this maintenance window to switch back to the primary data center. This will make the maintenance window tomorrow unnecessary, but it will cause some downtime in the next minutes.

Avatar for Christo Karafermanof
Christo Karafermanof
Updated

Our system are back up and running in the secondary data center.

Avatar for Christo Karafermanof
Christo Karafermanof
Updated

The disaster recovery exercise has started and as expected our system are experiencing some downtime while we are switching over to our secondary data center. We will update you as soon as we have new information.

Avatar for Christo Karafermanof
Christo Karafermanof
Underway

The scheduled maintenance is now underway. We'll keep you updated on our progress.

Scheduled

We will run our procedures for the case of the catastrophic failure of our main data center and will switch over to our disaster recovery data center in a another geographic region. During the switchover our systems might not be available for up to one hour. Based on past performance we expect a downtime of around 45 minutes.

Avatar for Christo Karafermanof
Christo Karafermanof
Began at:

Affected components
  • New Threat Intelligence Portal
  • eCrime Threat Intelligence Portal
    • AntiPhishing
    • CIRK
    • CrimeWare
    • Insight Articles
    • Statistics
  • APIs
    • RIRK API
    • Brand Abuse / AntiPhishing API
    • Threat Feeds API