blacksmith - Elevated error rates in Sticky Disk and Actions Cache requests – Incident details

All systems operational

Elevated error rates in Sticky Disk and Actions Cache requests

Resolved
Degraded performance
Started 2 days agoLasted about 1 hour

Affected

Incremental Docker Builders

Degraded performance from 10:45 PM to 10:55 PM, Operational from 10:55 PM to 11:37 PM

eu-central Storage Cluster

Degraded performance from 10:45 PM to 10:55 PM, Operational from 10:55 PM to 11:37 PM

us-west Storage Cluster

Degraded performance from 10:45 PM to 10:55 PM, Operational from 10:55 PM to 11:37 PM

eu-west Storage Cluster

Degraded performance from 10:45 PM to 10:55 PM, Operational from 10:55 PM to 11:37 PM

Docker Container Cache

Degraded performance from 10:45 PM to 10:55 PM, Operational from 10:55 PM to 11:37 PM

eu-central Storage Cluster

Degraded performance from 10:45 PM to 10:55 PM, Operational from 10:55 PM to 11:37 PM

Updates
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Update
    UTC
    Update

    We are still monitoring recovery.

  • Monitoring
    UTC
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    UTC
    Investigating

    We are seeing elevated error rates for Sticky Disk and Actions Cache requests. We are investigating.