Update - The amount of time taken for writes to become readable has returned to the normal operating level. We will continue to monitor and update.
Jan 26, 2023 - 22:33 UTC
Update - We are continuing to monitor for any further issues.
Jan 26, 2023 - 19:53 UTC
Update - The region is currently experiencing elevated times for written information to become queryable along with elevated query run times. All written information is still being safely queued. We are working to minimize disruptions and we will continue to update as the situation evolves.
Jan 26, 2023 - 18:38 UTC
Monitoring - The storage engine has completed processing the bursted traffic. Writes are now queryable within the normal time ranges. Our team will continue to monitor.
Jan 26, 2023 - 03:06 UTC
Identified - The region received another burst of write traffic causing backup into the queueing system. Heavily bursting traffic has now been limited on a per organization basis. All organizations impacted by this limitation have been notified. The storage system is currently processing the bursted traffic. We will update here as the storage engine completes this processing.
Jan 26, 2023 - 02:29 UTC
Investigating - We are seeing a return of the delayed reads and writes issue from a few hours ago. Our team is actively investigating.
Jan 26, 2023 - 01:21 UTC
Monitoring - We have identified the primary contributing factor for performance degradation (delayed writes and subsequent temporary read discrepancies). The impacted region has been receiving a large burst of writes twice daily which has saturated the storage layer. All writes to this region have been successfully recorded within our queuing system but are taking much longer than expected to become queryable. In response to this event, we have increased the resources available to the storage system. In addition, we have paused all tertiary background processes in the region to expedite recovery. We will continue to provide updates as the storage system recovers and will provide a complete root cause analysis when this incident has been resolved.
Jan 25, 2023 - 19:53 UTC
Update - We are continuing to work on a fix for this issue.
Jan 25, 2023 - 18:12 UTC
Update - We are continuing to work on a fix for this issue.
Jan 25, 2023 - 16:06 UTC
Update - We are continuing to work on a fix for this issue.
Jan 25, 2023 - 14:45 UTC
Update - We are continuing to work on a fix for this issue.
Jan 25, 2023 - 13:50 UTC
Update - We have deployed some minor updates to the cluster but still continue to investigate the issue
Jan 25, 2023 - 09:29 UTC
Update - We are continuing to work on a fix for this issue.
Jan 25, 2023 - 07:32 UTC
Update - We are continuing to work on a fix for this issue.
Jan 25, 2023 - 05:53 UTC
Update - We are continuing to work on a fix for this issue.
Jan 25, 2023 - 03:44 UTC
Update - We are continuing to work on a fix for this issue.
Jan 25, 2023 - 01:25 UTC
Update - We are continuing to work on a fix for this issue.
Jan 24, 2023 - 23:43 UTC
Update - We are continuing to work on this issue and a fix is being implemented.
Jan 24, 2023 - 21:00 UTC
Update - The issue has been identified and a fix is still being implemented.
Jan 24, 2023 - 19:50 UTC
Identified - The issue has been identified and a fix is being implemented.
Jan 24, 2023 - 17:41 UTC
Update - The AWS regions specified are experiencing delayed write/query operations and intermittent query failures.
We are continuing to investigate the issue.

Jan 24, 2023 - 15:57 UTC
Update - We are continuing to investigate this issue.
Jan 24, 2023 - 13:50 UTC
Investigating - We are currently investigating this issue.
Jan 24, 2023 - 13:11 UTC
Google Cloud: Iowa, US-Central Operational
90 days ago
100.0 % uptime
Today
Web UI ? Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
Google Cloud: Belgium, Europe-West-1 Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
AWS: Frankfurt, EU-Central-1 Degraded Performance
90 days ago
99.96 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Degraded Performance
90 days ago
99.93 % uptime
Today
API Queries Degraded Performance
90 days ago
99.95 % uptime
Today
Tasks Operational
90 days ago
99.97 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
AWS: Oregon, US-West-2-1 Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
AWS: Oregon, US-West-2-2 Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
AWS: Virginia, US-East-1 Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
Azure: Amsterdam, West Europe Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
Azure: Virginia, East US Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
AWS: Sydney, AP-Southeast-2 Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other ? Operational
Other Services ? Operational
90 days ago
100.0 % uptime
Today
Web UI Authentication (Auth0) Operational
90 days ago
100.0 % uptime
Today
Marketplace integrations ? Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.
Past Incidents
Jan 27, 2023

No incidents reported today.

Jan 26, 2023

Unresolved incident: Delayed reads and writes in eu-central-1.

Jan 25, 2023
Resolved - Incident has been resolved for any more info please check out https://status.azure.com/en-gb/status
Jan 25, 11:49 UTC
Monitoring - We have identified a recent change to WAN as the underlying cause, and have taken steps to roll back this change. Our telemetry shows consistent signs of recovery from 09:45 UTC onwards across multiple regions and services. Most customers should now see full recovery as WAN networking has recovered fully.

We are working to monitor and ensure full recovery for services that were impacted.

The next update will be in 30 minutes or as soon as we have further information.

This message was last updated at 10:28 UTC on 25 January 2023

https://status.azure.com/en-gb/status

Jan 25, 10:50 UTC
Investigating - Azure has advised there are networking issues in multiple regions and this might affect customers. This impacts connectivity between clients on the internet to Azure, as well as connectivity between services in datacenters, as well as ExpressRoute connections. The issue is causing impact in waves, peaking approximately every 30 minutes.

You can find more details on https://status.azure.com/en-gb/status

Jan 25, 09:31 UTC
Jan 24, 2023
Jan 23, 2023
Resolved - This incident has been resolved, and the delete operations have been re-enabled.
Jan 23, 18:14 UTC
Monitoring - Delete operations have temporarily been suspended, the delay is decreasing steadily. We will continue to monitor the issue and provide further updates
Jan 23, 16:37 UTC
Update - Delete operations have temporarily been suspended whilst the team investigate the root cause, customers will not currently be able to run predicate based deletes in this region.
Jan 23, 13:57 UTC
Identified - The issue has been identified and the team is working on a fix.
Jan 23, 12:32 UTC
Investigating - We are seeing the writes and query performance delayed, but there are no loss in writes. The team is investigating the issue and will we will provide further updates soon
Jan 23, 11:38 UTC
Jan 22, 2023

No incidents reported.

Jan 21, 2023

No incidents reported.

Jan 20, 2023
Resolved - This incident has been resolved.
Jan 20, 07:35 UTC
Monitoring - A fix has been implemented and we are monitoring the results.
Jan 20, 07:19 UTC
Investigating - We are currently investigating this issue.
Jan 20, 06:53 UTC
Jan 19, 2023

No incidents reported.

Jan 18, 2023

No incidents reported.

Jan 17, 2023

No incidents reported.

Jan 16, 2023

No incidents reported.

Jan 15, 2023

No incidents reported.

Jan 14, 2023

No incidents reported.

Jan 13, 2023

No incidents reported.