Status | Blacksmith - Delay in GitHub assigning jobs resulting in queueing – Incident details

All systems operational

Delay in GitHub assigning jobs resulting in queueing

Resolved
Partial outage
Started over 1 year agoLasted about 1 hour

Affected

Blacksmith Managed Runners

API

Operational from 4:49 AM to 5:48 AM

Website

Operational from 4:49 AM to 5:48 AM

Github → Actions

Degraded performance from 4:49 AM to 4:55 AM, Major outage from 4:55 AM to 5:12 AM, Degraded performance from 5:12 AM to 5:48 AM

Github → API Requests

Operational from 4:49 AM to 5:48 AM

Github → Webhooks

Operational from 4:49 AM to 5:48 AM

Updates
  • Resolved
    Resolved

  • Monitoring
    Monitoring

    There seems to be signs of recovery with GitHub now assigning jobs to newly triggered runs. It is possible that previously queued jobs will have to be canceled and retried to get them to run.

  • Update
    Update

    GitHub is not assigning any jobs to our runners, we're escalating this to an outage while we wait for them to report an issue on their end.

  • Investigating
    Investigating

    We are noticing GitHub taking several minutes to assign our runners a job, we are monitoring the situation.