blacksmith - Notice history

All systems operational

100% - uptime

eu-central Storage Cluster - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

us-west Storage Cluster - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

eu-west Storage Cluster - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Actions Cache - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Runtime Build Caching - Operational

API - Operational

100% - uptime
Mar 2026 · 99.97%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Website - Operational

100% - uptime
Mar 2026 · 99.97%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Github → Actions - Operational

Github → API Requests - Operational

Github → Webhooks - Operational

https://blacksmith.sh - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Codesmith - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Website - Operational

100% - uptime
Mar 2026 · 100.0%Apr · 100.0%May · 100.0%

Previous page

Next page

Mar 2026
Apr 2026
May 2026

Notice history

May 2026

Delay in picking up jobs
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Update
    UTC
    Update

    We're continuing to monitor the situation. There's still a slight delay in jobs, but cancelling and rerunning the jobs should resolve the issue.

  • Monitoring
    UTC
    Monitoring

    Continuing to monitor improvements from deployment.

  • Identified
    UTC
    Identified

    We've deployed mitigations and are observing improvements.

  • Investigating
    UTC
    Investigating
    We are currently investigating this incident.
Github reporting degraded performance for API Requests, Git Operations and other services
  • Resolved
    UTC
    Resolved

    Github have resolved this incident.

  • Monitoring
    UTC
    Monitoring

    We will continue to monitor - https://www.githubstatus.com/incidents/xy1tt3hs572m

GitHub reporting degraded performance for Actions
  • Resolved
    UTC
    Resolved

    Github have resolved this incident.

  • Monitoring
    UTC
    Monitoring

    GitHub is reporting degraded performance with Actions as well as other services. This may have an impact on job adoption.
    We are monitoring this incident - https://www.githubstatus.com/incidents/gnftqj9htp0g

Delays in job adoption in eu-west
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Identified
    UTC
    Identified

    We are continuing to monitor this, as well as track an incident reported by with GitHub Actions which can be found here:

    https://www.githubstatus.com/incidents/g6ffrm0rfvz9

    We are continuing to re-balance in order to reduce delays.

  • Investigating
    UTC
    Investigating

    We're seeing a spike of jobs in the eu-west region leading to a temporary capacity shortage. We're looking into re-balancing to reduce the delays

Transparent caching degradaded in eu-west
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring

    The cluster expansion is complete. Our testing shows that cache interactions are no longer degraded. We're monitoring the cluster to confirm complete recovery.

  • Update
    UTC
    Update

    We're currently adding more capacity to the cluster. There will be a few minutes of slow cache interactions while the operation completes.

  • Identified
    UTC
    Identified

    We have identified a bad host in the fleet and are working on replacing it. Client cache interactions are recovering as we rollout this fix.

  • Monitoring
    UTC
    Monitoring

    We noticed a small uptick in transparent caching failures in our eu-west region, and have applied a potential fix.

Apr 2026

Degraded Actions performance in us-west
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Update
    UTC
    Update

    We are continuing to see recovery in us-west

  • Monitoring
    UTC
    Monitoring

    We are aware of some reports of slow Actions performance in our us-west region. A mitigation has been applied and we're now seeing signs of recovery

Blacksmith control plane DB maintenance
  • Resolved
    UTC
    Resolved

    This incident has been resolved.

  • Update
    UTC
    Update

    The re-queuing is still in progress however new jobs are being picked up without delay.

  • Monitoring
    UTC
    Monitoring

    We have completed the DB operation and currently re-queuing jobs. This may take ~15 minutes

  • Investigating
    UTC
    Investigating

    We are performing brief maintenance on our database. Customers may experience some delays with job adoption

Github Actions Degraded
  • Resolved
    UTC
    Resolved

    GitHub resolved their upstream outage and we are not seeing any customer impact.

  • Investigating
    UTC
    Investigating

    GitHub is reporting a GitHub Actions degradation, and we're monitoring the impact https://www.githubstatus.com/incidents/6bkk045k741z

Github Actions and Packages degraded
  • Resolved
    UTC
    Resolved

    This incident has been resolved by Github.

  • Monitoring
    UTC
    Monitoring

    It seems that there's still trailing effects from the incident and we're seeing queue times due to slow webhook delivery.

  • Resolved
    UTC
    Resolved

    This incident has been resolved by Github.

  • Investigating
    UTC
    Investigating

    We are currently monitoring the effects of a Github outage: https://www.githubstatus.com/incidents/3f30ycplyr7l

Sticky Disk degradation in the US-WEST cluster
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring

    We needed to perform an emergency maintenance operation in our storage cluster. We are observing the recovery and seeing docker build speeds improve.

  • Investigating
    UTC
    Investigating
    We are currently investigating this incident.

Mar 2026

GitHub Actions & Webhooks Degraded Performance
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Investigating
    UTC
    Investigating

    We're seeing issues with Webhook ingestion and Actions due to this GitHub incident: https://www.githubstatus.com/incidents/kp06czybl7dw

    We are currently investigating this incident.

Control Plane Outage affecting Job Adoption
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    UTC
    Investigating

    We are seeing issues with our control plane endpoints. This may affect job adoption. We are investigating the issue.

Actions Cache Capacity Upgrade
  • Completed
    March 20, 2026 at 1:15 AMUTC
    Completed
    March 20, 2026 at 1:15 AMUTC
    Maintenance has completed successfully
  • In progress
    March 20, 2026 at 1:00 AMUTC
    In progress
    March 20, 2026 at 1:00 AMUTC
    Maintenance is now in progress
  • Planned
    March 20, 2026 at 1:00 AMUTC
    Planned
    March 20, 2026 at 1:00 AMUTC

    We are upgrading the Actions Cache capacity, cache performance may be degraded during this maintenance window.

Elevated Queue Times for x86 Runners
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring

    Queue times are no longer elevated. We are continuing to monitor.

  • Investigating
    UTC
    Investigating

    Queue times for x86 runners are elevated. We are currently investigating this incident.

Elevated Queue Times for ARM runners in EU Region
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Investigating
    UTC
    Investigating

    Queue times for ARM runners in our eu-central region are elevated. We are currently investigating this incident.

Mar 2026 to May 2026

Next