Update - We are continuing to monitor this issue.
Sep 17, 20:44 UTC
Update - We have rolled out a fix and continuing to monitor. The issues should be resolved.
Sep 17, 17:09 UTC
Monitoring - We have rolled out a fix and continuing to monitor. The issues should be resolved.
Sep 17, 14:44 UTC
Update - queries are currently running slowly in us-west. The team is working on a fix and continue to make progress
Sep 17, 14:29 UTC
Update - queries are currently running slowly in us-west. The team is working on a fix and continue to make progress
Sep 17, 13:54 UTC
Update - We are continuing to work on a fix for this issue.
Sep 17, 13:32 UTC
Identified - queries are currently running slowly in us-west. The team is working on a fix, and expect full service to be restored soon.
Sep 17, 13:32 UTC
Google Cloud: Iowa, US-Central Operational
90 days ago
99.99 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
99.96 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Google Cloud Platform Google Cloud Pub/Sub Operational
Google Cloud: Belgium, Europe-West-1 Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
AWS: Frankfurt, EU-Central-1 Operational
90 days ago
99.98 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
99.96 % uptime
Today
Tasks Operational
90 days ago
99.96 % uptime
Today
Persistent Storage Operational
Compute Operational
AWS kinesis-eu-central-1 Operational
AWS: Oregon, US-West-2 Degraded Performance
90 days ago
99.99 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Degraded Performance
90 days ago
99.98 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
AWS kinesis-us-west-2 Operational
AWS: Virginia, US-East-1 Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
AWS kinesis-us-east-1 Operational
Azure: Amsterdam, West Europe Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Azure: Virginia, East US Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
Other Services ? Operational
90 days ago
100.0 % uptime
Today
Web UI Authentication (Auth0) Operational
90 days ago
100.0 % uptime
Today
AWS: Sydney, AP-Southeast-2 Operational
90 days ago
100.0 % uptime
Today
Web UI Operational
90 days ago
100.0 % uptime
Today
API Writes Operational
90 days ago
100.0 % uptime
Today
API Queries Operational
90 days ago
100.0 % uptime
Today
Tasks Operational
90 days ago
100.0 % uptime
Today
Persistent Storage Operational
Compute Operational
AWS kinesis-ap-southeast-2 Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.
Past Incidents
Sep 19, 2021

No incidents reported today.

Sep 18, 2021

No incidents reported.

Sep 17, 2021
Resolved - This incident has been resolved.
Sep 17, 19:41 UTC
Monitoring - Service has been restored for reads, writes, queries and tasks. We are monitoring the situation actively.
Sep 17, 18:14 UTC
Update - (Updating components)
The team is monitoring writes, and full service seems to have been restored for writes. The team continues to re-enable services necessary for reads, and expects to recover for reads within hours. The team does not have a more precise ETA for recovering reads yet, but will update when they have more data.
Sep 17, 17:23 UTC
Update - The team is monitoring writes, and full service seems to have been restored for writes. The team continues to re-enable services necessary for reads, and expects to recover for reads within hours. The team does not have a more precise ETA for recovering reads yet, but will update when they have more data.
Sep 17, 16:49 UTC
Update - Write availability has been restored. Customers should not see any further errors on the write path.

We are beginning the process of restoring read availability. This will involve provisioning further resources and will take some time. We won't restore read availability until we are confident writes are available.
Sep 17, 15:50 UTC
Update - We are finalising the provision of resources necessary to completely restore write availability. We expect this to be completed very soon. Reads remain unavailable on the cluster and the team is working to provision all resources necessary to fully restore read availability
Sep 17, 15:35 UTC
Update - The team continues to implement the recovery process. Currently, they estimate that write availability will be recovered in the next 2 hours, though please be advised this is only their best good faith estimate. We expect read availability to be restored after write availability. The team expects that will take hours as well, but does not have a more specific estimate at this time.
Sep 17, 15:02 UTC
Update - The team continues to make progress restoring service. However, they are still unable to supply an updated estimate for full system recovery. They still anticipate it will be measured in hours.
Sep 17, 14:29 UTC
Update - The team continues to make progress restoring service. However, they are still unable to supply an updated estimate for full system recovery. They still anticipate it will be measured in hours.
Sep 17, 13:51 UTC
Update - aws-eu-central region is still down. The team is making progress, The current plan is that writes will be back online before reads will be available. We have re-confirmed that there does not appear to be any data loss
Sep 17, 12:57 UTC
Update - aws-eu-central region is still down. The team is making progress, but we don't have an updated estimate for when service will be restored yet. We have re-confirmed that there does not appear to be any data loss.
Sep 17, 12:46 UTC
Update - A configuration/operator error caused all compute in our aws-eu-central to be disabled. This incident is limited only to aws-eu-central. Data that has already been written is safe. The engineering team is working on restoring functionality to the cluster. Unfortunately, current estimates for downtime during recovered is measured in hours. We will continue to update as our estimates improve
Sep 17, 12:09 UTC
Identified - The cluster is down, we have identified the issue and we are working on it to resolve the issue
Sep 17, 11:36 UTC
Update - The cluster is down and we are working on it to resolve the issue
Sep 17, 11:15 UTC
Update - The cluster is down and we are working on it to resolve the issue
Sep 17, 11:00 UTC
Update - We are continuing to investigate this issue.
Sep 17, 10:49 UTC
Investigating - We are currently investigating this issue.
Sep 17, 10:49 UTC
Sep 16, 2021
Resolved - This incident has been resolved.
Sep 16, 05:18 UTC
Monitoring - We identified query timeouts affecting AWS us-west-2 region users. At this point, the issue seems to be resolved but our team continues to monitor the situation.
Sep 16, 05:06 UTC
Sep 15, 2021

No incidents reported.

Sep 14, 2021

No incidents reported.

Sep 13, 2021

No incidents reported.

Sep 12, 2021

No incidents reported.

Sep 11, 2021

No incidents reported.

Sep 10, 2021

No incidents reported.

Sep 9, 2021

No incidents reported.

Sep 8, 2021

No incidents reported.

Sep 7, 2021
Resolved - The incident has been resolved.
Sep 7, 22:03 UTC
Update - We are continuing our investigation into this incident and are monitoring for further issues.
Sep 7, 19:58 UTC
Update - We are continuing to monitor for any further issues.
Sep 7, 12:19 UTC
Update - Our team has made changes and we are actively monitoring the situation.
Sep 7, 08:36 UTC
Monitoring - We continue to monitor for any issues.
Sep 7, 06:08 UTC
Investigating - We are currently investigating this issue.
Sep 7, 06:07 UTC
Monitoring - A fix has been implemented and we are monitoring the results.
Sep 7, 05:24 UTC
Investigating - We are currently investigating this issue.
Sep 7, 04:24 UTC
Monitoring - Our team is actively monitoring the situation.
Sep 7, 01:23 UTC
Investigating - We are currently investigating this issue.
Sep 7, 00:39 UTC
Sep 6, 2021

No incidents reported.

Sep 5, 2021

No incidents reported.