blacksmith - Job failures in EU West – Incident details

All systems operational

Job failures in EU West

Resolved
Degraded performance
Started 11 days agoLasted about 2 hours

Affected

Github → API Requests

Degraded performance from 3:00 PM to 3:31 PM, Operational from 3:31 PM to 4:44 PM

Updates
  • Resolved
    UTC
    Resolved

    This incident is resolved. Job failures in our eu-west region returned to normal levels at 15:15 UTC and have remained there since; any jobs that failed between approximately 12:20 and 15:15 UTC with the error "The self-hosted runner lost communication with the server" can be safely re-run.

  • Monitoring
    UTC
    Monitoring

    Between approximately 12:20 and 15:15 UTC, some jobs in our eu-west region failed with the GitHub error "The self-hosted runner lost communication with the server"; other regions were unaffected. Job failures in eu-west returned to normal levels as of 15:15 UTC, and any affected jobs can be safely re-run while we continue to investigate the underlying cause.

  • Investigating
    UTC
    Investigating

    Since approximately 12:20 UTC, some jobs in our eu-west region have been failing with the GitHub error "The self-hosted runner lost communication with the server"; other regions are unaffected. Affected jobs can be safely re-run while we continue to investigate the underlying cause.