blacksmith - Elevated error rates in Blacksmith APIs – Incident details

Elevated error rates in Blacksmith APIs

Resolved
Degraded performance
Started 8 days agoLasted 9 minutes

Affected

Blacksmith Managed Runners

Degraded performance from 6:37 PM to 6:47 PM

US West

Degraded performance from 6:37 PM to 6:47 PM

us-west ARM

Degraded performance from 6:37 PM to 6:47 PM

us-west x86

Degraded performance from 6:37 PM to 6:47 PM

EU Central

Degraded performance from 6:37 PM to 6:47 PM

eu-central ARM

Degraded performance from 6:37 PM to 6:47 PM

Updates
  • Resolved
    UTC
    Resolved

    This issue has been resolved, and all services have operating normally. If any of your jobs failed during this time, please re-run them.

  • Identified
    UTC
    Identified

    We are seeing elevated errors in job adoption and other control plane APIs. This is yielding higher latencies for your job to be adopted. You may also see certain actions fail, such as actions caching and sticky disks. We have identified the issue and are rolling out a mitigation.