Post-Mortem of Outage of Thursday 26th of August
What happened?
At 00:25 we received an alert from our automated liveness checks that our systems were down.
The team immediately mobilized to establish comms and update our StatusPage. An investigation
was initiated. Symtoms were similar to those seen during the previous outages caused by
instabilities from our hosting provider. A few minutes afterwards, we received confirmation
from our host provider that they were experiencing issues at their London Data Center.
Brandweerrooster was offline for 0h57m on 26/8/2022.
FireServiceRota was offline for 0h57m on 26/8/2022.
For more technical information about the issue, please refer to the postmortem from
our provider.
What we will do to prevent this?
Since the last outages caused by the host provider, we've initiated migrating actions
to have redundancy accross multiple host providers. We aim to have the new setup
ready before the end of the year.
For more information about the actions we are taking, please refer the this link.