Closed | Jul 19, 2024 | 12:50 GMT+01:00
Services are stable now and closing this issue. Will continue to monitor the application health.
Monitoring | Jul 19, 2024 | 04:16 GMT+01:00
We have worked with azure and brought our services back online. We are currently monitoring the situation.
Status from azure:
https://azure.status.microsoft/en-in/status
Impact Statement: Starting at 21:56 UTC on 18 Jul 2024, you have been identified as a customer using Virtual Machines in Central US who may experience connection failures when trying to access some Virtual Machines hosted in the region. These Virtual Machines may have also restarted unexpectedly.
Current Status: We are aware of this issue and have engaged multiple teams. We have determined the underlying cause. A backend cluster management workflow deployed a configuration change causing backend access to be blocked between a subset of Azure Storage clusters and compute resources in the Central US region. This resulted in the compute resources automatically restarting when connectivity was lost to virtual disks. We are currently applying mitigation. Customers should see signs of recovery at this time as mitigation applies across resources in the region. The next update will be provided in 60 minutes, or as events warrant.
Open | Jul 19, 2024 | 00:25 GMT+01:00
We are currently facing downtime in the Portal and User Authentication applications within our US environment, caused by a disruption in Azure services in the Central US region. Our team is actively investigating this issue.