blacksmith - Delay in GitHub assigning jobs resulting in queueing – Incident details

All systems operational

Delay in GitHub assigning jobs resulting in queueing

Resolved
Partial outage
Started about 2 years agoLasted 58 minutes

Affected

Blacksmith Managed Runners

API

Operational from 4:49 AM to 5:48 AM

Website

Github → Actions

Operational from 4:49 AM to 5:48 AM

Github → API Requests

Operational from 4:49 AM to 5:48 AM

Github → Webhooks

Operational from 4:49 AM to 5:48 AM

Updates
  • Resolved
    UTC
    Resolved

  • Monitoring
    UTC
    Monitoring

    There seems to be signs of recovery with GitHub now assigning jobs to newly triggered runs. It is possible that previously queued jobs will have to be canceled and retried to get them to run.

  • Update
    UTC
    Update

    GitHub is not assigning any jobs to our runners, we're escalating this to an outage while we wait for them to report an issue on their end.

  • Investigating
    UTC
    Investigating

    We are noticing GitHub taking several minutes to assign our runners a job, we are monitoring the situation.