blacksmith - Delay in picking up jobs – Incident details

Delay in picking up jobs

ResolvedMajor outage5 hours 16 minutes

Affected

Blacksmith Managed Runners

Major outage from 7:01 PM to 8:24 PM, Degraded performance from 8:24 PM to 12:18 AM

US West

Major outage from 7:01 PM to 8:24 PM, Degraded performance from 8:24 PM to 12:18 AM

us-west ARM

Major outage from 7:01 PM to 8:24 PM, Degraded performance from 8:24 PM to 12:18 AM

us-west x86

Major outage from 7:01 PM to 8:24 PM, Degraded performance from 8:24 PM to 12:18 AM

EU Central

Major outage from 7:01 PM to 8:24 PM, Degraded performance from 8:24 PM to 12:18 AM

eu-central ARM

Major outage from 7:01 PM to 8:24 PM, Degraded performance from 8:24 PM to 12:18 AM

  • ResolvedUTC
    This incident has been resolved.
  • UpdateUTC

    We're continuing to monitor the situation. There's still a slight delay in jobs, but cancelling and rerunning the jobs should resolve the issue.

  • MonitoringUTC

    Continuing to monitor improvements from deployment.

  • IdentifiedUTC

    We've deployed mitigations and are observing improvements.

  • InvestigatingUTC
    We are currently investigating this incident.