Status | Blacksmith - Notice history

All systems operational

100% - uptime

eu-central Storage Cluster - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

us-west Storage Cluster - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Actions Cache - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

API - Operational

100% - uptime
Mar 2026 · 99.97%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Website - Operational

100% - uptime
Mar 2026 · 99.97%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Github → Actions - Operational

Github → API Requests - Operational

Github → Webhooks - Operational

Notice history

May 2026

Delays in job adoption in eu-west
  • Resolved
    Resolved
    This incident has been resolved.
  • Identified
    Identified

    We are continuing to monitor this, as well as track an incident reported by with GitHub Actions which can be found here:

    https://www.githubstatus.com/incidents/g6ffrm0rfvz9

    We are continuing to re-balance in order to reduce delays.

  • Investigating
    Investigating

    We're seeing a spike of jobs in the eu-west region leading to a temporary capacity shortage. We're looking into re-balancing to reduce the delays

Transparent caching degradaded in eu-west
  • Monitoring
    Monitoring

    The cluster expansion is complete. Our testing shows that cache interactions are no longer degraded. We're monitoring the cluster to confirm complete recovery.

  • Update
    Update

    We're currently adding more capacity to the cluster. There will be a few minutes of slow cache interactions while the operation completes.

  • Identified
    Identified

    We have identified a bad host in the fleet and are working on replacing it. Client cache interactions are recovering as we rollout this fix.

  • Monitoring
    Monitoring

    We noticed a small uptick in transparent caching failures in our eu-west region, and have applied a potential fix.

GitHub webhooks degraded causing job queueing
  • Resolved
    Resolved
    This incident has been resolved.
  • Update
    Update

    We are close to the end of the backlog of the queued tasks and are seeing full recovery in certain runner pools.

  • Update
    Update

    We're still working through a substantial backlog of queued tasks that has accumulated over this period of delayed webhook arrivals.

  • Update
    Update

    We're still seeing a large backlog of queued jobs due to the incident that the system is working through, we're exploring mitigations.

  • Monitoring
    Monitoring

    We're seeing upstream recovery for GitHub webhook deliveries. Jobs may queue as we process GitHub's backlog of webhook events.

  • Investigating
    Investigating

    We're seeing evidence of webhooks delivery being degraded from GitHub. We're investigating.

Github Actions degraded
  • Resolved
    Resolved

    Github have reportedly resolved the incident

  • Identified
    Identified

    GitHub is reporting a GitHub Actions degradation, and we're monitoring the impact - https://www.githubstatus.com/incidents/ctf7nxpq5jzn

Job Queueing due to Capacity Event
  • Resolved
    Resolved
    This incident has been resolved.
  • Investigating
    Investigating

    We are currently experiencing a high volume of jobs which is causing queuing in job adoption.

Apr 2026

Degraded Actions performance in us-west
  • Resolved
    Resolved
    This incident has been resolved.
  • Update
    Update

    We are continuing to see recovery in us-west

  • Monitoring
    Monitoring

    We are aware of some reports of slow Actions performance in our us-west region. A mitigation has been applied and we're now seeing signs of recovery

Blacksmith control plane DB maintenance
  • Resolved
    Resolved

    This incident has been resolved.

  • Update
    Update

    The re-queuing is still in progress however new jobs are being picked up without delay.

  • Monitoring
    Monitoring

    We have completed the DB operation and currently re-queuing jobs. This may take ~15 minutes

  • Investigating
    Investigating

    We are performing brief maintenance on our database. Customers may experience some delays with job adoption

Github Actions Degraded
  • Resolved
    Resolved

    GitHub resolved their upstream outage and we are not seeing any customer impact.

  • Investigating
    Investigating

    GitHub is reporting a GitHub Actions degradation, and we're monitoring the impact https://www.githubstatus.com/incidents/6bkk045k741z

Github Actions and Packages degraded
  • Resolved
    Resolved

    This incident has been resolved by Github.

  • Monitoring
    Monitoring

    It seems that there's still trailing effects from the incident and we're seeing queue times due to slow webhook delivery.

  • Resolved
    Resolved

    This incident has been resolved by Github.

  • Investigating
    Investigating

    We are currently monitoring the effects of a Github outage: https://www.githubstatus.com/incidents/3f30ycplyr7l

Sticky Disk degradation in the US-WEST cluster
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We needed to perform an emergency maintenance operation in our storage cluster. We are observing the recovery and seeing docker build speeds improve.

  • Investigating
    Investigating
    We are currently investigating this incident.

Mar 2026

GitHub Actions & Webhooks Degraded Performance
  • Resolved
    Resolved
    This incident has been resolved.
  • Investigating
    Investigating

    We're seeing issues with Webhook ingestion and Actions due to this GitHub incident: https://www.githubstatus.com/incidents/kp06czybl7dw

    We are currently investigating this incident.

Control Plane Outage affecting Job Adoption
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    Investigating

    We are seeing issues with our control plane endpoints. This may affect job adoption. We are investigating the issue.

Actions Cache Capacity Upgrade
  • Completed
    March 20, 2026 at 1:15 AM
    Completed
    March 20, 2026 at 1:15 AM
    Maintenance has completed successfully
  • In progress
    March 20, 2026 at 1:00 AM
    In progress
    March 20, 2026 at 1:00 AM
    Maintenance is now in progress
  • Planned
    March 20, 2026 at 1:00 AM
    Planned
    March 20, 2026 at 1:00 AM

    We are upgrading the Actions Cache capacity, cache performance may be degraded during this maintenance window.

Elevated Queue Times for x86 Runners
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    Queue times are no longer elevated. We are continuing to monitor.

  • Investigating
    Investigating

    Queue times for x86 runners are elevated. We are currently investigating this incident.

Elevated Queue Times for ARM runners in EU Region
  • Resolved
    Resolved
    This incident has been resolved.
  • Investigating
    Investigating

    Queue times for ARM runners in our eu-central region are elevated. We are currently investigating this incident.

Mar 2026 to May 2026

Next