blacksmith - Delays in job adoption in us-west – Incident details

All systems operational

Delays in job adoption in us-west

Resolved
Degraded performance
Started about 2 months agoLasted about 2 hours

Affected

Blacksmith Managed Runners

Degraded performance from 8:25 PM to 10:18 PM

US West

Degraded performance from 8:25 PM to 10:18 PM

us-west x86

Degraded performance from 8:25 PM to 10:18 PM

Incremental Docker Builders

Degraded performance from 8:25 PM to 9:08 PM, Operational from 9:08 PM to 10:18 PM

us-west Storage Cluster

Degraded performance from 8:25 PM to 9:08 PM, Operational from 9:08 PM to 10:18 PM

Docker Container Cache

Degraded performance from 8:25 PM to 9:08 PM, Operational from 9:08 PM to 10:18 PM

Updates
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Investigating
    UTC
    Investigating

    We're seeing a spike of jobs in the us-west region leading to a temporary capacity shortage. We're looking into re-balancing to reduce the delaysWe are currently investigating this incident.