DocEvent - Issue with downloads for all services except for S3 – Incident details

Issue with downloads for all services except for S3

Resolved
Degraded performance
Started 5 months agoLasted about 6 hours

Affected

us-east-1

Degraded performance from 4:25 AM to 2:00 PM

SFS

Degraded performance from 4:25 AM to 2:00 PM

eu-west-1

Degraded performance from 4:25 AM to 2:00 PM

SFS

Degraded performance from 4:25 AM to 2:00 PM

ap-southeast-2

Degraded performance from 4:25 AM to 2:00 PM

SFS

Degraded performance from 4:25 AM to 2:00 PM

Updates
  • Resolved
    Resolved
    This incident has been resolved.
  • Identified
    Identified

    An update was released to a canary deployment to initially us-east-1 region, then ap-southeast-2 and eu-west-1, this caused errors to occur occasionally for GET requests for all services except for S3.

    This deployment was later rolled out wider within all regions, as the deployment rolled out more errors were found with GET requests. This release has now been rolled back and has since been resolved.

    The root cause of the issue in the deployment has since been found.

    This incident has been resolved.