Multiple Services Disruption

[investigating] As of 08:00 UTC our Engineering team is investigating an issue affecting multiple DigitalOcean services due to an incident with an upstream provider. As a result, users attempting to log in using SMS-based 2FA may experience problems receiveing codes and complete authentication. Images hosted exclusively on Docker Hub may also be temporarily unavailable, impacting deployments on DigitalOcean Kubernetes (DOKS) and App Platform. Additionally, the users leveraging SnapShooter for serverless backups may encounter failures in backup jobs as well. We're now seeing signs of recovery, and most of the requests should be succeeding. We will continue to monitor closely to ensure full service restoration and will share an update as more information becomes available.

[resolved] Between 08:00 UTC and 22:53 UTC, an issue with an upstream provider affected multiple DigitalOcean services, including SMS-based 2FA (causing code delivery failures), Docker Hub-hosted images (impacting Managed Kubernetes and App Platform deployments), and SnapShooter backup jobs. The issue has been resolved, and all services are now stable and operating normally. We appreciate your patience throughout this but if you continue to experience any issues, please create a support ticket from within the Cloud Control Panel for further analysis.

[investigating] Our Engineering team is actively investigating an issue impacting multiple DigitalOcean services caused by an upstream provider incident. This disruption affects a subset of Gen AI tools, the App Platform, Load Balancer, and Spaces. Users may experience degraded performance or intermittent failures within these services. We acknowledge the inconvenience this may cause and are working diligently to restore normal operations. Signs of recovery are starting to appear, with most requests beginning to succeed. We will continue to monitor the situation closely and provide timely updates as more information becomes available. Thank you for your patience as we work towards full service restoration

[investigating] Our Engineering team is actively investigating an issue impacting multiple DigitalOcean services caused by an upstream provider incident. This disruption affects a subset of Gen AI tools, the App Platform, Load Balancer, Spaces and provisioning or management actions for new clusters. Existing clusters are not affected. Users may experience degraded performance or intermittent failures within these services. We acknowledge the inconvenience this may cause and are working diligently to restore normal operations. Signs of recovery are starting to appear, with most requests beginning to succeed. We will continue to monitor the situation closely and provide timely updates as more information becomes available. Thank you for your patience as we work towards full service restoration.

[monitoring] Our engineering team has observed that the external network incident impacting multiple DigitalOcean services has been mitigated. The affected services including Gen AI tools, App Platform, Load Balancer, Spaces, and provisioning or management actions for new clusters are showing continued signs of recovery, with most requests now completing successfully. Our engineering team continues to monitor the situation closely. We will post an update as soon as the issue is fully resolved. We apologize for the disruption and appreciate your patience.

[resolved] Our Engineering team has confirmed that the external network incident affecting multiple DigitalOcean services has been fully mitigated. The impacted services including Gen AI tools, App Platform, Load Balancers, Spaces, and provisioning or management actions for new clusters have recovered and are now operating normally. All requests are completing successfully. Thank you for your patience. If you continue to experience any issues, please open a support ticket from within your account.