blacksmith - Delays In Job Adoption – Incident details

Experiencing minor outage

Delays In Job Adoption

Resolved
Major outage
Started 2 months agoLasted about 3 hours

Affected

Blacksmith Managed Runners

Degraded performance from 4:35 PM to 7:38 PM

us-west ARM

Degraded performance from 4:35 PM to 7:38 PM

us-west x86

Degraded performance from 4:35 PM to 7:38 PM

eu-central ARM

Degraded performance from 4:35 PM to 7:38 PM

eu-central x86

Degraded performance from 4:35 PM to 7:38 PM

eu-west x86

Degraded performance from 4:35 PM to 7:38 PM

Updates
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring

    us-west still experiencing some mild queueing, and eu-central and eu-west has recovered.

  • Identified
    UTC
    Identified

    We are continuing to work on a fix for this incident. eu-central and us-west still experiencing some queueing, and eu-west has recovered.

  • Investigating
    UTC
    Investigating

    We're seeing a spike in jobs in some regions leading to a temporary capacity shortage. We're looking into re-balancing to reduce the delays