blacksmith - Notice history

We are currently investigating this incident. We have been alerted about some steps in GitHub Action workflows such as checking out the repository and logging in to GHCR taking much longer than usual.

Our dashboard analytics are stale due to the previous incident. We've identified the issue and are working on a fix.

We are currently noticing higher than normal queue times for orgs running in our US region, we are looking into whether this is an upstream GitHub issue

We are getting notified of a potential GitHub outage that is causing jobs to not get assigned to our runners, we are monitoring the situation.

We are currently investigating reports of degraded performance of our Docker builders in the US region. This may affect jobs using useblackmith/build-push-action@v1

We are currently investigating a higher than normal rate of failures when hitting our Blacksmith cace.

GitHub is taking longer than usual to assign jobs to our runners which may manifest as longer queue times. We are looking into this incident.

We are currently investigating delays in GitHub Actions jobs being picked up by our runners in the EU.

We're seeing signs of recovery after deploying a few fixes, we are continuing to monitor our cache health.

We're seeing a higher-than-usual rate of failures for cache restores from the Blacksmith cache. We are currently investigating this incident.

We are being alerted about some orgs seeing higher than usual queue times. GitHub is not assigning jobs to our runners in a timely fashion, we are looking into this.

We are noticing jobs taking longer than usual to get picked up in our US fleet.