Status | Blacksmith Status - Incident history https://status.blacksmith.sh Status | Blacksmith Sat, 18 Apr 2026 16:00:00 +0000 Storage cluster maintenance Type: Maintenance Duration: 1 hour Affected Components: Stickydisks, Docker Container Cache, Incremental Docker Builders Apr 18, 16:00:00 GMT+0 - Identified - We are planning for a scheduled maintenance during that time. Apr 18, 16:00:01 GMT+0 - Identified - Maintenance is now in progress Apr 18, 17:00:00 GMT+0 - Completed - Maintenance has completed successfully Type: Maintenance

Duration: 1 hour

Affected Components: , ,

<p><small>Apr <var data-var='date'> 18</var>, <var data-var='time'>16:00:00</var> GMT+0</small><br><strong>Identified</strong> - We are planning for a scheduled maintenance during that time..</p> <p><small>Apr <var data-var='date'> 18</var>, <var data-var='time'>16:00:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> <p><small>Apr <var data-var='date'> 18</var>, <var data-var='time'>17:00:00</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully.</p> ]]> Sat, 18 Apr 2026 16:00:00 +0000 https://status.blacksmith.sh/maintenance/cmo3v7gpf05zh113vmek4t8cd https://status.blacksmith.sh/maintenance/cmo3v7gpf05zh113vmek4t8cd Job queue backlog being processed Type: Incident Duration: 18 minutes Affected Components: EU X86, US X86, EU-WEST x86, US ARM, EU ARM Apr 16, 17:00:07 GMT+0 - Identified - We're currently working through a backlog of queued jobs that accumulated due to a blip in our backend. The queue is actively draining and we expect it to fully clear in \~5 minutes. We will provide updates here. Apr 16, 17:12:39 GMT+0 - Monitoring - We're continuing to process queued jobs and will provide another update shortly. Apr 16, 17:18:28 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 18 minutes

Affected Components: , , , ,

<p><small>Apr <var data-var='date'> 16</var>, <var data-var='time'>17:00:07</var> GMT+0</small><br><strong>Identified</strong> - We're currently working through a backlog of queued jobs that accumulated due to a blip in our backend. The queue is actively draining and we expect it to fully clear in \~5 minutes. We will provide updates here..</p> <p><small>Apr <var data-var='date'> 16</var>, <var data-var='time'>17:12:39</var> GMT+0</small><br><strong>Monitoring</strong> - We're continuing to process queued jobs and will provide another update shortly..</p> <p><small>Apr <var data-var='date'> 16</var>, <var data-var='time'>17:18:28</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Thu, 16 Apr 2026 17:00:07 +0000 https://status.blacksmith.sh/incident/cmo1q64h50072d2qjobuxvzga https://status.blacksmith.sh/incident/cmo1q64h50072d2qjobuxvzga Elevated Queue Times for US x86 Runners Type: Incident Duration: 30 minutes Affected Components: US X86 Apr 13, 18:41:57 GMT+0 - Investigating - Queue times for US x86 runners are currently elevated. We are currently investigating this incident. Apr 13, 19:03:37 GMT+0 - Monitoring - Queue times are at expected levels. We are continuing to monitor. Apr 13, 19:12:15 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 30 minutes

Affected Components:

<p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>18:41:57</var> GMT+0</small><br><strong>Investigating</strong> - Queue times for US x86 runners are currently elevated. We are currently investigating this incident..</p> <p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>19:03:37</var> GMT+0</small><br><strong>Monitoring</strong> - Queue times are at expected levels. We are continuing to monitor..</p> <p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>19:12:15</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Mon, 13 Apr 2026 18:41:57 +0000 https://status.blacksmith.sh/incident/cmnxjhisg042joz3zi4mwos8n https://status.blacksmith.sh/incident/cmnxjhisg042joz3zi4mwos8n Storage cluster expansion in US-West Type: Maintenance Duration: 1 hour Affected Components: Incremental Docker Builders Apr 12, 04:00:00 GMT+0 - Identified - We are planning for a scheduled maintenance during that time. Apr 12, 04:00:01 GMT+0 - Identified - Maintenance is now in progress Apr 12, 05:00:00 GMT+0 - Completed - Maintenance has completed successfully Type: Maintenance

Duration: 1 hour

Affected Components:

<p><small>Apr <var data-var='date'> 12</var>, <var data-var='time'>04:00:00</var> GMT+0</small><br><strong>Identified</strong> - We are planning for a scheduled maintenance during that time..</p> <p><small>Apr <var data-var='date'> 12</var>, <var data-var='time'>04:00:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> <p><small>Apr <var data-var='date'> 12</var>, <var data-var='time'>05:00:00</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully.</p> ]]> Sun, 12 Apr 2026 04:00:00 +0000 https://status.blacksmith.sh/maintenance/cmntoekwg05r1lkmpl5bgu89o https://status.blacksmith.sh/maintenance/cmntoekwg05r1lkmpl5bgu89o Running emergency maintenance on our storage cluster to size it up and eliminate degraded interactions Type: Maintenance Duration: 20 minutes Affected Components: Incremental Docker Builders Apr 8, 18:45:00 GMT+0 - Identified - Maintenance is now in progress. Apr 8, 18:35:00 GMT+0 - Identified - We are planning for an emergency maintenance on our storage cluster to size it up to eliminate degraded interactions. All sticky disk cache entries will be wiped as part of this maintenance. Apr 8, 18:55:38 GMT+0 - Completed - Maintenance has completed successfully. Type: Maintenance

Duration: 20 minutes

Affected Components:

<p><small>Apr <var data-var='date'> 8</var>, <var data-var='time'>18:45:00</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress..</p> <p><small>Apr <var data-var='date'> 8</var>, <var data-var='time'>18:35:00</var> GMT+0</small><br><strong>Identified</strong> - We are planning for an emergency maintenance on our storage cluster to size it up to eliminate degraded interactions. All sticky disk cache entries will be wiped as part of this maintenance..</p> <p><small>Apr <var data-var='date'> 8</var>, <var data-var='time'>18:55:38</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully..</p> ]]> Wed, 8 Apr 2026 18:35:00 +0000 https://status.blacksmith.sh/maintenance/cmnqe334y014214aryjb4qz5n https://status.blacksmith.sh/maintenance/cmnqe334y014214aryjb4qz5n GitHub Actions & Webhooks Degraded Performance Type: Incident Duration: 30 minutes Affected Components: Github → Actions, Github → Webhooks Mar 24, 20:28:39 GMT+0 - Investigating - We're seeing issues with Webhook ingestion and Actions due to this GitHub incident: <https://www.githubstatus.com/incidents/kp06czybl7dw> We are currently investigating this incident. Mar 24, 20:58:30 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 30 minutes

Affected Components: ,

<p><small>Mar <var data-var='date'> 24</var>, <var data-var='time'>20:28:39</var> GMT+0</small><br><strong>Investigating</strong> - We're seeing issues with Webhook ingestion and Actions due to this GitHub incident: <https://www.githubstatus.com/incidents/kp06czybl7dw> We are currently investigating this incident..</p> <p><small>Mar <var data-var='date'> 24</var>, <var data-var='time'>20:58:30</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 24 Mar 2026 20:28:39 +0000 https://status.blacksmith.sh/incident/cmn52hotd0257ipvc32eh1s9o https://status.blacksmith.sh/incident/cmn52hotd0257ipvc32eh1s9o Control Plane Outage affecting Job Adoption Type: Incident Duration: 1 hour and 45 minutes Affected Components: EU X86, Website, US X86, EU-WEST x86, US ARM, API, EU ARM, , Blacksmith Managed Runners → Mar 23, 16:19:35 GMT+0 - Investigating - We are seeing issues with our control plane endpoints. This may affect job adoption. We are investigating the issue. Mar 23, 16:33:05 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Mar 23, 18:05:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 45 minutes

Affected Components: , , , , , , ,

<p><small>Mar <var data-var='date'> 23</var>, <var data-var='time'>16:19:35</var> GMT+0</small><br><strong>Investigating</strong> - We are seeing issues with our control plane endpoints. This may affect job adoption. We are investigating the issue..</p> <p><small>Mar <var data-var='date'> 23</var>, <var data-var='time'>16:33:05</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Mar <var data-var='date'> 23</var>, <var data-var='time'>18:05:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Mon, 23 Mar 2026 16:19:35 +0000 https://status.blacksmith.sh/incident/cmn3e5jet001n387ybdzex6pf https://status.blacksmith.sh/incident/cmn3e5jet001n387ybdzex6pf Actions Cache Capacity Upgrade Type: Maintenance Duration: 15 minutes Affected Components: Actions Cache Mar 20, 01:00:00 GMT+0 - Identified - We are upgrading the Actions Cache capacity, cache performance may be degraded during this maintenance window. Mar 20, 01:00:01 GMT+0 - Identified - Maintenance is now in progress Mar 20, 01:15:00 GMT+0 - Completed - Maintenance has completed successfully Type: Maintenance

Duration: 15 minutes

Affected Components:

<p><small>Mar <var data-var='date'> 20</var>, <var data-var='time'>01:00:00</var> GMT+0</small><br><strong>Identified</strong> - We are upgrading the Actions Cache capacity, cache performance may be degraded during this maintenance window..</p> <p><small>Mar <var data-var='date'> 20</var>, <var data-var='time'>01:00:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> <p><small>Mar <var data-var='date'> 20</var>, <var data-var='time'>01:15:00</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully.</p> ]]> Fri, 20 Mar 2026 01:00:00 +0000 https://status.blacksmith.sh/maintenance/cmmxvkdzi01z8ozdt5iktinib https://status.blacksmith.sh/maintenance/cmmxvkdzi01z8ozdt5iktinib Elevated Queue Times for x86 Runners Type: Incident Duration: 1 hour and 4 minutes Affected Components: EU X86, US X86 Mar 17, 16:05:45 GMT+0 - Investigating - Queue times for x86 runners are elevated. We are currently investigating this incident. Mar 17, 16:58:41 GMT+0 - Monitoring - Queue times are no longer elevated. We are continuing to monitor. Mar 17, 17:10:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 4 minutes

Affected Components: ,

<p><small>Mar <var data-var='date'> 17</var>, <var data-var='time'>16:05:45</var> GMT+0</small><br><strong>Investigating</strong> - Queue times for x86 runners are elevated. We are currently investigating this incident..</p> <p><small>Mar <var data-var='date'> 17</var>, <var data-var='time'>16:58:41</var> GMT+0</small><br><strong>Monitoring</strong> - Queue times are no longer elevated. We are continuing to monitor..</p> <p><small>Mar <var data-var='date'> 17</var>, <var data-var='time'>17:10:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 17 Mar 2026 16:05:45 +0000 https://status.blacksmith.sh/incident/cmmut0nbe015dxe2lis05nb00 https://status.blacksmith.sh/incident/cmmut0nbe015dxe2lis05nb00 Elevated Queue Times for ARM runners in EU Region Type: Incident Duration: 46 minutes Affected Components: EU ARM Mar 16, 13:54:52 GMT+0 - Investigating - Queue times for ARM runners in our eu-central region are elevated. We are currently investigating this incident. Mar 16, 14:41:17 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 46 minutes

Affected Components:

<p><small>Mar <var data-var='date'> 16</var>, <var data-var='time'>13:54:52</var> GMT+0</small><br><strong>Investigating</strong> - Queue times for ARM runners in our eu-central region are elevated. We are currently investigating this incident..</p> <p><small>Mar <var data-var='date'> 16</var>, <var data-var='time'>14:41:17</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Mon, 16 Mar 2026 13:54:52 +0000 https://status.blacksmith.sh/incident/cmmt8wguw0biowv24qwa6y85v https://status.blacksmith.sh/incident/cmmt8wguw0biowv24qwa6y85v GitHub reporting degraded performance for Actions Type: Incident Duration: 52 minutes Affected Components: Github → Actions Mar 13, 15:24:42 GMT+0 - Monitoring - GitHub is reporting degraded performance with Actions as well as other services. This may have impact on job adoption. We are monitoring this incident. <https://www.githubstatus.com/incidents/xsxcyn25nfmq> Mar 13, 16:17:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 52 minutes

Affected Components:

<p><small>Mar <var data-var='date'> 13</var>, <var data-var='time'>15:24:42</var> GMT+0</small><br><strong>Monitoring</strong> - GitHub is reporting degraded performance with Actions as well as other services. This may have impact on job adoption. We are monitoring this incident. <https://www.githubstatus.com/incidents/xsxcyn25nfmq>.</p> <p><small>Mar <var data-var='date'> 13</var>, <var data-var='time'>16:17:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Fri, 13 Mar 2026 15:24:42 +0000 https://status.blacksmith.sh/incident/cmmp1sfqo05kn7qyg9ust3mk7 https://status.blacksmith.sh/incident/cmmp1sfqo05kn7qyg9ust3mk7 Elevated queue times in our EU region Type: Incident Duration: 2 hours and 16 minutes Affected Components: EU X86, EU ARM Mar 11, 15:55:11 GMT+0 - Investigating - Queue times in our eu-central region are elevated. We are currently investigating this incident. Mar 11, 18:11:19 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 2 hours and 16 minutes

Affected Components: ,

<p><small>Mar <var data-var='date'> 11</var>, <var data-var='time'>15:55:11</var> GMT+0</small><br><strong>Investigating</strong> - Queue times in our eu-central region are elevated. We are currently investigating this incident..</p> <p><small>Mar <var data-var='date'> 11</var>, <var data-var='time'>18:11:19</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Wed, 11 Mar 2026 15:55:11 +0000 https://status.blacksmith.sh/incident/cmmm7zxu50bvc129qgtk3em25 https://status.blacksmith.sh/incident/cmmm7zxu50bvc129qgtk3em25 Elevated Queue Times in US region Type: Incident Duration: 1 hour and 54 minutes Affected Components: US X86 Mar 10, 17:18:00 GMT+0 - Investigating - We are seeing elevated queue times in our US region for x86 runners. We are currently investigating this incident. Mar 10, 18:49:56 GMT+0 - Monitoring - Queue times are no longer elevated. We're continuing to monitor. Mar 10, 19:11:44 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 54 minutes

Affected Components:

<p><small>Mar <var data-var='date'> 10</var>, <var data-var='time'>17:18:00</var> GMT+0</small><br><strong>Investigating</strong> - We are seeing elevated queue times in our US region for x86 runners. We are currently investigating this incident..</p> <p><small>Mar <var data-var='date'> 10</var>, <var data-var='time'>18:49:56</var> GMT+0</small><br><strong>Monitoring</strong> - Queue times are no longer elevated. We're continuing to monitor..</p> <p><small>Mar <var data-var='date'> 10</var>, <var data-var='time'>19:11:44</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 10 Mar 2026 17:18:00 +0000 https://status.blacksmith.sh/incident/cmmkviljt006qwgcwzmstoci6 https://status.blacksmith.sh/incident/cmmkviljt006qwgcwzmstoci6 Delays in ARM job adoption in the US region Type: Incident Duration: 3 hours and 52 minutes Affected Components: US ARM Mar 9, 20:27:52 GMT+0 - Identified - Queue times remain elevated for ARM runners in the US. Mar 9, 22:29:00 GMT+0 - Resolved - This incident has been resolved. Mar 9, 18:37:12 GMT+0 - Investigating - We are currently investigating this incident. Type: Incident

Duration: 3 hours and 52 minutes

Affected Components:

<p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>20:27:52</var> GMT+0</small><br><strong>Identified</strong> - Queue times remain elevated for ARM runners in the US..</p> <p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>22:29:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>18:37:12</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> ]]> Mon, 9 Mar 2026 18:37:12 +0000 https://status.blacksmith.sh/incident/cmmjiwlga0010c8ku9611inlr https://status.blacksmith.sh/incident/cmmjiwlga0010c8ku9611inlr GitHub Webhooks Experiencing Degraded Performance Type: Incident Duration: 1 hour and 5 minutes Affected Components: Github → Webhooks Mar 9, 16:03:58 GMT+0 - Monitoring - We're seeing issues with GitHub Webhooks due to this incident: <https://www.githubstatus.com/incidents/7k92rcz4f1zq> We're monitoring and will continue to provide updates. Mar 9, 17:09:26 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 5 minutes

Affected Components:

<p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>16:03:58</var> GMT+0</small><br><strong>Monitoring</strong> - We're seeing issues with GitHub Webhooks due to this incident: <https://www.githubstatus.com/incidents/7k92rcz4f1zq> We're monitoring and will continue to provide updates..</p> <p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>17:09:26</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Mon, 9 Mar 2026 16:03:58 +0000 https://status.blacksmith.sh/incident/cmmjdfj9x03ux1jixvr1nex5a https://status.blacksmith.sh/incident/cmmjdfj9x03ux1jixvr1nex5a GitHub Actions Degraded Availability Type: Incident Duration: 1 hour and 28 minutes Affected Components: Github → Actions, Github → Webhooks, Github → API Requests Mar 5, 23:12:36 GMT+0 - Identified - An upstream GitHub Actions incident was declared and we are seeing instability running actions. We are seeing signs of partial recovery but jobs may take longer than expected to be picked up. <https://www.githubstatus.com/incidents/g9j4tmfqdd09> Mar 5, 23:44:13 GMT+0 - Identified - We are seeing recovery but queue times in both regions remain elevated as we recover from GitHub's Action outage. <https://www.githubstatus.com/incidents/g9j4tmfqdd09> Mar 6, 00:40:59 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 28 minutes

Affected Components: , ,

<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>23:12:36</var> GMT+0</small><br><strong>Identified</strong> - An upstream GitHub Actions incident was declared and we are seeing instability running actions. We are seeing signs of partial recovery but jobs may take longer than expected to be picked up. <https://www.githubstatus.com/incidents/g9j4tmfqdd09>.</p> <p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>23:44:13</var> GMT+0</small><br><strong>Identified</strong> - We are seeing recovery but queue times in both regions remain elevated as we recover from GitHub's Action outage. <https://www.githubstatus.com/incidents/g9j4tmfqdd09>.</p> <p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>00:40:59</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Thu, 5 Mar 2026 23:12:36 +0000 https://status.blacksmith.sh/incident/cmme2zckv004vnkrp2ygaxnmr https://status.blacksmith.sh/incident/cmme2zckv004vnkrp2ygaxnmr GitHub Actions Degraded Availability Type: Incident Duration: 2 hours and 37 minutes Affected Components: Github → Actions, Github → API Requests Mar 5, 17:29:55 GMT+0 - Monitoring - We are seeing recovery from GitHub's APIs and jobs getting picked up again. We expect a bit of a backlog as jobs get run from during the incident duration. Mar 5, 19:13:20 GMT+0 - Monitoring - Upstream incident is resolved. There may be slightly elevated wait times for jobs to be picked up as the last of the incident backlog is caught up. Mar 5, 19:23:33 GMT+0 - Resolved - This incident has been resolved. Mar 5, 16:46:21 GMT+0 - Investigating - GitHub has declared Actions is experiencing Degraded Availability and indicated multiple services are experiencing service degradation. We're tracking this incident and will provide updates as GitHub provides them. <https://www.githubstatus.com/incidents/g5gnt5l5hf56> Mar 5, 17:11:53 GMT+0 - Identified - We are seeing severe degradation in GitHub API causing jobs to not get picked up. Type: Incident

Duration: 2 hours and 37 minutes

Affected Components: ,

<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>17:29:55</var> GMT+0</small><br><strong>Monitoring</strong> - We are seeing recovery from GitHub's APIs and jobs getting picked up again. We expect a bit of a backlog as jobs get run from during the incident duration..</p> <p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>19:13:20</var> GMT+0</small><br><strong>Monitoring</strong> - Upstream incident is resolved. There may be slightly elevated wait times for jobs to be picked up as the last of the incident backlog is caught up..</p> <p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>19:23:33</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>16:46:21</var> GMT+0</small><br><strong>Investigating</strong> - GitHub has declared Actions is experiencing Degraded Availability and indicated multiple services are experiencing service degradation. We're tracking this incident and will provide updates as GitHub provides them. <https://www.githubstatus.com/incidents/g5gnt5l5hf56>.</p> <p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>17:11:53</var> GMT+0</small><br><strong>Identified</strong> - We are seeing severe degradation in GitHub API causing jobs to not get picked up..</p> ]]> Thu, 5 Mar 2026 16:46:21 +0000 https://status.blacksmith.sh/incident/cmmdp6mrg153ydfl6t5a5gs1a https://status.blacksmith.sh/incident/cmmdp6mrg153ydfl6t5a5gs1a GitHub API Request Failures Type: Incident Duration: 2 hours and 9 minutes Affected Components: Github → Actions, Github → Webhooks, Github → API Requests Mar 3, 19:01:08 GMT+0 - Identified - We're seeing upstream failures against GitHub's API. Job adoption and GitHub interactions in running jobs may be affected. Mar 3, 19:04:00 GMT+0 - Identified - GitHub has declared an outage affecting APIs and Actions: <https://www.githubstatus.com/incidents/n07yy1bk6kc4> Mar 3, 19:52:48 GMT+0 - Monitoring - GitHub has implemented a fix and we are beginning to see recovery. Git operations remain degraded. We will continue to monitor. <https://www.githubstatus.com/incidents/n07yy1bk6kc4> Mar 3, 21:10:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 2 hours and 9 minutes

Affected Components: , ,

<p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>19:01:08</var> GMT+0</small><br><strong>Identified</strong> - We're seeing upstream failures against GitHub's API. Job adoption and GitHub interactions in running jobs may be affected..</p> <p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>19:04:00</var> GMT+0</small><br><strong>Identified</strong> - GitHub has declared an outage affecting APIs and Actions: <https://www.githubstatus.com/incidents/n07yy1bk6kc4>.</p> <p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>19:52:48</var> GMT+0</small><br><strong>Monitoring</strong> - GitHub has implemented a fix and we are beginning to see recovery. Git operations remain degraded. We will continue to monitor. <https://www.githubstatus.com/incidents/n07yy1bk6kc4>.</p> <p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>21:10:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 3 Mar 2026 19:01:08 +0000 https://status.blacksmith.sh/incident/cmmaz49em0cgtij45rdnsbesw https://status.blacksmith.sh/incident/cmmaz49em0cgtij45rdnsbesw Scheduled maintenance of our database Type: Maintenance Duration: 4 minutes Affected Components: US ARM, EU X86, US X86, EU ARM, , Blacksmith Managed Runners → Feb 28, 18:07:00 GMT+0 - Identified - We are running an operation on our database that may result in a short blip in service. Customers may notice longer queue times during this window. Feb 28, 18:05:51 GMT+0 - Identified - Maintenance is now in progress. Feb 28, 18:10:10 GMT+0 - Completed - Maintenance has completed successfully. Type: Maintenance

Duration: 4 minutes

Affected Components: , , , ,

<p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>18:07:00</var> GMT+0</small><br><strong>Identified</strong> - We are running an operation on our database that may result in a short blip in service. Customers may notice longer queue times during this window..</p> <p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>18:05:51</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress..</p> <p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>18:10:10</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully..</p> ]]> Sat, 28 Feb 2026 18:07:00 +0000 https://status.blacksmith.sh/maintenance/cmm6mtfip0dlxbpwwxx888gdk https://status.blacksmith.sh/maintenance/cmm6mtfip0dlxbpwwxx888gdk Delays in Job Adoption & Degraded Git Operations Type: Incident Duration: 12 hours and 34 minutes Affected Components: US ARM, EU X86, US X86, Github → Actions, EU ARM, , Blacksmith Managed Runners → Feb 25, 21:19:09 GMT+0 - Investigating - We are investigating reports of delays in jobs being adopted and degraded interactions with GitHub services. Feb 25, 21:32:38 GMT+0 - Investigating - We are continuing to investigate delays in job adoption and degraded Git interactions, mostly for Checkout actions. This appears to be related to an upstream GitHub outage. We are monitoring the situation and will provide updates as more information becomes available. Feb 26, 09:53:39 GMT+0 - Resolved - This incident has been resolved. Feb 26, 04:55:00 GMT+0 - Monitoring - We're seeing signs of recovery and are continuing to monitor. Type: Incident

Duration: 12 hours and 34 minutes

Affected Components: , , , , ,

<p><small>Feb <var data-var='date'> 25</var>, <var data-var='time'>21:19:09</var> GMT+0</small><br><strong>Investigating</strong> - We are investigating reports of delays in jobs being adopted and degraded interactions with GitHub services..</p> <p><small>Feb <var data-var='date'> 25</var>, <var data-var='time'>21:32:38</var> GMT+0</small><br><strong>Investigating</strong> - We are continuing to investigate delays in job adoption and degraded Git interactions, mostly for Checkout actions. This appears to be related to an upstream GitHub outage. We are monitoring the situation and will provide updates as more information becomes available. .</p> <p><small>Feb <var data-var='date'> 26</var>, <var data-var='time'>09:53:39</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Feb <var data-var='date'> 26</var>, <var data-var='time'>04:55:00</var> GMT+0</small><br><strong>Monitoring</strong> - We're seeing signs of recovery and are continuing to monitor..</p> ]]> Wed, 25 Feb 2026 21:19:09 +0000 https://status.blacksmith.sh/incident/cmm2jenko04qa84k9c5ow5jye https://status.blacksmith.sh/incident/cmm2jenko04qa84k9c5ow5jye Running emergency maintenance on our storage cluster to size it up and eliminate degraded interactions Type: Maintenance Duration: 9 minutes Affected Components: Incremental Docker Builders Feb 25, 14:00:00 GMT+0 - Identified - We are planning for an emergency maintenance on our storage cluster to size it up to eliminate degraded interactions. All sticky disk cache entries will be wiped as part of this maintenance. Feb 26, 00:28:40 GMT+0 - Identified - Maintenance is now in progress. Feb 26, 00:37:41 GMT+0 - Completed - Maintenance has completed successfully the storage cluster is back to serving requests normally. Type: Maintenance

Duration: 9 minutes

Affected Components:

<p><small>Feb <var data-var='date'> 25</var>, <var data-var='time'>14:00:00</var> GMT+0</small><br><strong>Identified</strong> - We are planning for an emergency maintenance on our storage cluster to size it up to eliminate degraded interactions. All sticky disk cache entries will be wiped as part of this maintenance..</p> <p><small>Feb <var data-var='date'> 26</var>, <var data-var='time'>00:28:40</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress..</p> <p><small>Feb <var data-var='date'> 26</var>, <var data-var='time'>00:37:41</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully the storage cluster is back to serving requests normally..</p> ]]> Wed, 25 Feb 2026 14:00:00 +0000 https://status.blacksmith.sh/maintenance/cmm2q3x9r0i1tg3s9gyg409u3 https://status.blacksmith.sh/maintenance/cmm2q3x9r0i1tg3s9gyg409u3 GH Actions Degraded Performance Type: Incident Duration: 44 minutes Affected Components: Github → Actions, Github → Webhooks, Github → API Requests Feb 23, 17:07:45 GMT+0 - Resolved - GitHub has marked this incident as resolved and we are seeing signs of full recovery. This incident has been resolved. <https://www.githubstatus.com/incidents/59rjsk76t3rf> Feb 23, 16:23:52 GMT+0 - Investigating - We are seeing issues with job adoption related to this GitHub incident - <https://www.githubstatus.com/incidents/59rjsk76t3rf> We will continue to monitor and provide updates here Type: Incident

Duration: 44 minutes

Affected Components: , ,

<p><small>Feb <var data-var='date'> 23</var>, <var data-var='time'>17:07:45</var> GMT+0</small><br><strong>Resolved</strong> - GitHub has marked this incident as resolved and we are seeing signs of full recovery. This incident has been resolved. <https://www.githubstatus.com/incidents/59rjsk76t3rf>.</p> <p><small>Feb <var data-var='date'> 23</var>, <var data-var='time'>16:23:52</var> GMT+0</small><br><strong>Investigating</strong> - We are seeing issues with job adoption related to this GitHub incident - <https://www.githubstatus.com/incidents/59rjsk76t3rf> We will continue to monitor and provide updates here.</p> ]]> Mon, 23 Feb 2026 16:23:52 +0000 https://status.blacksmith.sh/incident/cmlzdz7lv05b8p79zoq7ucmac https://status.blacksmith.sh/incident/cmlzdz7lv05b8p79zoq7ucmac Delays in Job Adoption Type: Incident Duration: 1 hour and 20 minutes Affected Components: US ARM, US X86 Feb 19, 17:30:35 GMT+0 - Investigating - We are seeing some delays in jobs being adopted. We are currently investigating this incident. Feb 19, 17:50:00 GMT+0 - Resolved - This incident has been resolved. Feb 19, 17:44:46 GMT+0 - Monitoring - We've identified the root cause to be a transient issue with GitHub's control plane that lasted for \~15 minutes. GitHub’s Actions broker service began rejecting session creation requests from our runners. While our runners were provisioned successfully, they were being rejected by the GitHub Actions broker service, causing the runner to exit without picking up a job. This led to job adoption observed delays. The issue resolved on its own as GitHub’s broker service recovered. We also manually requeued jobs that were affected. We're seeing recovery in job adoption and queue times are no longer elevated. We will continue to monitor. Type: Incident

Duration: 1 hour and 20 minutes

Affected Components: ,

<p><small>Feb <var data-var='date'> 19</var>, <var data-var='time'>17:30:35</var> GMT+0</small><br><strong>Investigating</strong> - We are seeing some delays in jobs being adopted. We are currently investigating this incident..</p> <p><small>Feb <var data-var='date'> 19</var>, <var data-var='time'>17:50:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Feb <var data-var='date'> 19</var>, <var data-var='time'>17:44:46</var> GMT+0</small><br><strong>Monitoring</strong> - We've identified the root cause to be a transient issue with GitHub's control plane that lasted for \~15 minutes. GitHub’s Actions broker service began rejecting session creation requests from our runners. While our runners were provisioned successfully, they were being rejected by the GitHub Actions broker service, causing the runner to exit without picking up a job. This led to job adoption observed delays. The issue resolved on its own as GitHub’s broker service recovered. We also manually requeued jobs that were affected. We're seeing recovery in job adoption and queue times are no longer elevated. We will continue to monitor..</p> ]]> Thu, 19 Feb 2026 17:30:35 +0000 https://status.blacksmith.sh/incident/cmltqllbp0e9u12d4lpxlwgci https://status.blacksmith.sh/incident/cmltqllbp0e9u12d4lpxlwgci Control Plane Degradation Impacting Job Adoption and Execution Type: Incident Duration: 6 minutes Affected Components: US ARM, EU X86, US X86, Website, EU ARM Feb 18, 16:46:52 GMT+0 - Investigating - We've identified a degradation in our control plane that is affecting job adoption, execution and dashboard interactions. We are currently investigating this incident. Feb 18, 16:48:26 GMT+0 - Monitoring - We've implemented a fix and are seeing complete recovery. We will continue to monitor. Feb 18, 16:52:25 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 6 minutes

Affected Components: , , , ,

<p><small>Feb <var data-var='date'> 18</var>, <var data-var='time'>16:46:52</var> GMT+0</small><br><strong>Investigating</strong> - We've identified a degradation in our control plane that is affecting job adoption, execution and dashboard interactions. We are currently investigating this incident..</p> <p><small>Feb <var data-var='date'> 18</var>, <var data-var='time'>16:48:26</var> GMT+0</small><br><strong>Monitoring</strong> - We've implemented a fix and are seeing complete recovery. We will continue to monitor..</p> <p><small>Feb <var data-var='date'> 18</var>, <var data-var='time'>16:52:25</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Wed, 18 Feb 2026 16:46:52 +0000 https://status.blacksmith.sh/incident/cmls9lih40bivc5dw9pir3hgz https://status.blacksmith.sh/incident/cmls9lih40bivc5dw9pir3hgz Increased Queue Times in our US Region Type: Incident Duration: 3 hours and 4 minutes Feb 10, 21:03:15 GMT+0 - Investigating - We are seeing increased queue times in our US region. We are currently investigating this incident. Feb 11, 00:06:54 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 3 hours and 4 minutes

<p><small>Feb <var data-var='date'> 10</var>, <var data-var='time'>21:03:15</var> GMT+0</small><br><strong>Investigating</strong> - We are seeing increased queue times in our US region. We are currently investigating this incident..</p> <p><small>Feb <var data-var='date'> 11</var>, <var data-var='time'>00:06:54</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 10 Feb 2026 21:03:15 +0000 https://status.blacksmith.sh/incident/cmlh38fec19zi1qtd9wclifm5 https://status.blacksmith.sh/incident/cmlh38fec19zi1qtd9wclifm5 Queueing in our EU Region Type: Incident Duration: 54 minutes Feb 10, 17:35:19 GMT+0 - Investigating - We are currently seeing increased queue times in our EU region. We are investigating this incident. Feb 10, 18:22:39 GMT+0 - Monitoring - Queue times in our EU region are now at expected levels. We are continuing to monitor. Feb 10, 18:29:37 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 54 minutes

<p><small>Feb <var data-var='date'> 10</var>, <var data-var='time'>17:35:19</var> GMT+0</small><br><strong>Investigating</strong> - We are currently seeing increased queue times in our EU region. We are investigating this incident..</p> <p><small>Feb <var data-var='date'> 10</var>, <var data-var='time'>18:22:39</var> GMT+0</small><br><strong>Monitoring</strong> - Queue times in our EU region are now at expected levels. We are continuing to monitor..</p> <p><small>Feb <var data-var='date'> 10</var>, <var data-var='time'>18:29:37</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 10 Feb 2026 17:35:19 +0000 https://status.blacksmith.sh/incident/cmlgvt0ns01aqtxhcepwy0jsa https://status.blacksmith.sh/incident/cmlgvt0ns01aqtxhcepwy0jsa Degradation affecting Dashboard, API and Job Adoption Type: Incident Duration: 14 minutes Feb 10, 16:46:11 GMT+0 - Investigating - We're seeing signs of degradation in our backend that is affecting multiple components. We are currently investigating this incident. Feb 10, 16:48:19 GMT+0 - Monitoring - We're seeing recovery and are monitoring. All components are operational. Feb 10, 17:00:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 14 minutes

<p><small>Feb <var data-var='date'> 10</var>, <var data-var='time'>16:46:11</var> GMT+0</small><br><strong>Investigating</strong> - We're seeing signs of degradation in our backend that is affecting multiple components. We are currently investigating this incident..</p> <p><small>Feb <var data-var='date'> 10</var>, <var data-var='time'>16:48:19</var> GMT+0</small><br><strong>Monitoring</strong> - We're seeing recovery and are monitoring. All components are operational..</p> <p><small>Feb <var data-var='date'> 10</var>, <var data-var='time'>17:00:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 10 Feb 2026 16:46:11 +0000 https://status.blacksmith.sh/incident/cmlgu1tsm17wx1qtdoi5pjv5q https://status.blacksmith.sh/incident/cmlgu1tsm17wx1qtdoi5pjv5q GH Actions Degraded Performance Type: Incident Duration: 1 hour and 12 minutes Affected Components: Github → Actions, Github → Webhooks, Github → API Requests Feb 9, 19:03:00 GMT+0 - Investigating - We are seeing issues with job adoption related to this GitHub incident <https://www.githubstatus.com/incidents/lcw3tg2f6zsd> We will continue to monitor and provide updates here Feb 9, 19:54:29 GMT+0 - Identified - Github has applied a mitigation and indicates they are seeing signs of recovery. <https://www.githubstatus.com/incidents/lcw3tg2f6zsd> We are continuing to monitor for full recovery Feb 9, 20:14:43 GMT+0 - Resolved - GitHub has marked this incident as resolved and we are seeing signs of full recovery. This incident has been resolved. <https://www.githubstatus.com/incidents/lcw3tg2f6zsd> Type: Incident

Duration: 1 hour and 12 minutes

Affected Components: , ,

<p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>19:03:00</var> GMT+0</small><br><strong>Investigating</strong> - We are seeing issues with job adoption related to this GitHub incident <https://www.githubstatus.com/incidents/lcw3tg2f6zsd> We will continue to monitor and provide updates here.</p> <p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>19:54:29</var> GMT+0</small><br><strong>Identified</strong> - Github has applied a mitigation and indicates they are seeing signs of recovery. <https://www.githubstatus.com/incidents/lcw3tg2f6zsd> We are continuing to monitor for full recovery.</p> <p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>20:14:43</var> GMT+0</small><br><strong>Resolved</strong> - GitHub has marked this incident as resolved and we are seeing signs of full recovery. This incident has been resolved. <https://www.githubstatus.com/incidents/lcw3tg2f6zsd>.</p> ]]> Mon, 9 Feb 2026 19:03:00 +0000 https://status.blacksmith.sh/incident/cmlfjhx5q0wkp10jy36m8hfos https://status.blacksmith.sh/incident/cmlfjhx5q0wkp10jy36m8hfos Runners and API are unavailable Type: Incident Duration: 56 minutes Affected Components: US ARM, EU X86, US X86, API, EU ARM, , Blacksmith Managed Runners → Feb 2, 09:46:23 GMT+0 - Investigating - We're currently experiencing service disruption due to an outage at one of our infrastructure providers Clickhouse, this may cause some disruption to the dashboard and runners -<https://statuspage.incident.io/clickhousecloud/incidents/01KG9R3JMK16VXF5CHBDZ4YNC9> Feb 2, 09:55:46 GMT+0 - Monitoring - We're seeing recovery and are monitoring closely. Feb 2, 09:59:37 GMT+0 - Monitoring - Systems are recovering & we are currently clearing the job queue backlog that was affected. If your jobs are still showing as queued, please cancel and re-run them to ensure they get picked up. Feb 2, 10:42:27 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 56 minutes

Affected Components: , , , , ,

<p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>09:46:23</var> GMT+0</small><br><strong>Investigating</strong> - We're currently experiencing service disruption due to an outage at one of our infrastructure providers Clickhouse, this may cause some disruption to the dashboard and runners -<https://statuspage.incident.io/clickhousecloud/incidents/01KG9R3JMK16VXF5CHBDZ4YNC9>.</p> <p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>09:55:46</var> GMT+0</small><br><strong>Monitoring</strong> - We're seeing recovery and are monitoring closely..</p> <p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>09:59:37</var> GMT+0</small><br><strong>Monitoring</strong> - Systems are recovering & we are currently clearing the job queue backlog that was affected. If your jobs are still showing as queued, please cancel and re-run them to ensure they get picked up. .</p> <p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>10:42:27</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Mon, 2 Feb 2026 09:46:23 +0000 https://status.blacksmith.sh/incident/cml4zj4xf0g76w7f5yiwdzc28 https://status.blacksmith.sh/incident/cml4zj4xf0g76w7f5yiwdzc28 Degraded speeds when interacting with GitHub and GHCR in US Type: Incident Duration: 1 hour and 12 minutes Affected Components: US ARM, US X86 Jan 31, 02:59:11 GMT+0 - Investigating - We are currently investigating this incident. Jan 31, 03:16:00 GMT+0 - Identified - Our data center provider has identified packet loss with a specific network carrier and are in the process of moving traffic off them Jan 31, 03:17:00 GMT+0 - Monitoring - We're noticing recovery across the US fleet for GitHub interactions since the traffic was moved off the identified carrier. Jan 31, 04:10:41 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 12 minutes

Affected Components: ,

<p><small>Jan <var data-var='date'> 31</var>, <var data-var='time'>02:59:11</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Jan <var data-var='date'> 31</var>, <var data-var='time'>03:16:00</var> GMT+0</small><br><strong>Identified</strong> - Our data center provider has identified packet loss with a specific network carrier and are in the process of moving traffic off them.</p> <p><small>Jan <var data-var='date'> 31</var>, <var data-var='time'>03:17:00</var> GMT+0</small><br><strong>Monitoring</strong> - We're noticing recovery across the US fleet for GitHub interactions since the traffic was moved off the identified carrier..</p> <p><small>Jan <var data-var='date'> 31</var>, <var data-var='time'>04:10:41</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Sat, 31 Jan 2026 02:59:11 +0000 https://status.blacksmith.sh/incident/cml1q3rn901ogddg5rtmgaln2 https://status.blacksmith.sh/incident/cml1q3rn901ogddg5rtmgaln2 Degraded speeds when interacting with upstream GitHub mirrors and GHCR in US Type: Incident Duration: 12 hours and 20 minutes Jan 30, 07:25:00 GMT+0 - Resolved - The incident has now been resolved. We were seeing severe tail latency during git checkout (minutes+) consistently correlated with a small set of GitHub edge IPs in the Ashburn region. Median checkout times were largely fine, but \~0.5–1% of operations hang for a very long time. We ruled out network side issues on our end and worked with our vendors to rule out congestion or packet loss. All signs pointed to a degraded edge node rather than a client or network issue. We were also seeing this intermittently affect GitHub-hosted runners, but it was more prominent on Blacksmith runners given our checkout concurrency and tail-latency instrumentation. We are actively working on solutions that will allow us to direct traffic to a different edge node in such situations in the future. We apologize for the inconvenience we may have caused. Jan 30, 00:06:01 GMT+0 - Investigating - We are currently investigating this incident. Jan 30, 01:58:44 GMT+0 - Investigating - We are continuing to investigate the issue. Type: Incident

Duration: 12 hours and 20 minutes

<p><small>Jan <var data-var='date'> 30</var>, <var data-var='time'>07:25:00</var> GMT+0</small><br><strong>Resolved</strong> - The incident has now been resolved. We were seeing severe tail latency during git checkout (minutes+) consistently correlated with a small set of GitHub edge IPs in the Ashburn region. Median checkout times were largely fine, but \~0.5–1% of operations hang for a very long time. We ruled out network side issues on our end and worked with our vendors to rule out congestion or packet loss. All signs pointed to a degraded edge node rather than a client or network issue. We were also seeing this intermittently affect GitHub-hosted runners, but it was more prominent on Blacksmith runners given our checkout concurrency and tail-latency instrumentation. We are actively working on solutions that will allow us to direct traffic to a different edge node in such situations in the future. We apologize for the inconvenience we may have caused..</p> <p><small>Jan <var data-var='date'> 30</var>, <var data-var='time'>00:06:01</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Jan <var data-var='date'> 30</var>, <var data-var='time'>01:58:44</var> GMT+0</small><br><strong>Investigating</strong> - We are continuing to investigate the issue..</p> ]]> Fri, 30 Jan 2026 00:06:01 +0000 https://status.blacksmith.sh/incident/cml04h8ir0b3nhgqm1d9dnky9 https://status.blacksmith.sh/incident/cml04h8ir0b3nhgqm1d9dnky9 Upgrading storage fleet in our EU region Type: Maintenance Duration: 1 hour Affected Components: Incremental Docker Builders Aug 6, 18:30:00 GMT+0 - Identified - We are going to be running an important upgrade to our storage fleet cluster that may cause interruptions in stickydisk and docker caching. The upgrade will cause a reset of all stickydisk entities causing runs to be uncached for the first time until the cache is rehydrated. Aug 6, 19:30:00 GMT+0 - Completed - Maintenance has completed successfully. Type: Maintenance

Duration: 1 hour

Affected Components:

<p><small>Aug <var data-var='date'> 6</var>, <var data-var='time'>18:30:00</var> GMT+0</small><br><strong>Identified</strong> - We are going to be running an important upgrade to our storage fleet cluster that may cause interruptions in stickydisk and docker caching. The upgrade will cause a reset of all stickydisk entities causing runs to be uncached for the first time until the cache is rehydrated..</p> <p><small>Aug <var data-var='date'> 6</var>, <var data-var='time'>19:30:00</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully..</p> ]]> Wed, 6 Aug 2025 18:30:00 +0000 https://status.blacksmith.sh/maintenance/cme0amp1c01moptag4xxn1qh0 https://status.blacksmith.sh/maintenance/cme0amp1c01moptag4xxn1qh0 Landing page undergoing maintenance Type: Maintenance Duration: 47 minutes Affected Components: Website Jun 30, 21:30:00 GMT+0 - Identified - There is ongoing maintenance on our landing page ([blacksmith.sh](http://blacksmith.sh)), but our dashboard and support portals are unaffected <https://app.blacksmith.sh/> Jun 30, 22:16:52 GMT+0 - Completed - Maintenance has completed successfully. Type: Maintenance

Duration: 47 minutes

Affected Components:

<p><small>Jun <var data-var='date'> 30</var>, <var data-var='time'>21:30:00</var> GMT+0</small><br><strong>Identified</strong> - There is ongoing maintenance on our landing page ([blacksmith.sh](http://blacksmith.sh)), but our dashboard and support portals are unaffected <https://app.blacksmith.sh/>.</p> <p><small>Jun <var data-var='date'> 30</var>, <var data-var='time'>22:16:52</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully..</p> ]]> Mon, 30 Jun 2025 21:30:00 +0000 https://status.blacksmith.sh/maintenance/cmcjmx54k0003ac3okuvr9tv3 https://status.blacksmith.sh/maintenance/cmcjmx54k0003ac3okuvr9tv3