Service Issue - Compute Hosts - Multiple Regions

Incident Report for Linode

Postmortem

Beginning at ~14:40 UTC on December 8, 2025, a subset of Compute hosts began to experience errors resolving DNS names including a core Linode database endpoint. Most Compute hosts had an active database connection and were able to process new jobs without impact. At that time a separate deployment of a new internal service was in process which required restarting the service and the re-establishment of database connections. Due to this restart, these hosts disconnected from the database and were unable to reconnect due to the DNS resolution problem.

This issue was due to a recent infrastructure code configuration update to switch these hosts to internal DNS resolvers over IPv6. The change was intended to be applied only to storage systems and unintentionally was applied to all hosts including Compute hosts.Once the offending configuration change was isolated, it was reverted. To resolve the issue, we worked through the impacted hosts, updating configurations in batches, so as to not introduce additional unnecessary impact, fully mitigating the issue at ~21:17 UTC on December 8, 2025. 

To prevent this issue from occurring in the future, we will decouple the currently-shared configurations whose update led to this impact. 

This summary provides an overview of our current understanding of the incident given the information available. Our investigation is ongoing and any information herein is subject to change.

Posted Dec 12, 2025 - 15:39 UTC

Resolved

We haven't observed any additional issues with jobs being issued and completed on Compute hosts, and will now consider this incident resolved. If you continue to experience issues, please contact us at 855-454-6633 (+1-609-380-7100 Intl.), or send an email to support@linode.com for assistance.
Posted Dec 09, 2025 - 16:59 UTC

Monitoring

At this time we have been able to correct the issue affecting jobs being issued and completed on Compute hosts. We will be monitoring this to ensure that the service remains stable. If you are still experiencing issues and unable to open a Support ticket, please call us at 855-454-6633 (+1-609-380-7100 Intl.), or send an email to support@linode.com.
Posted Dec 08, 2025 - 21:17 UTC

Identified

Our team has identified the issue affecting jobs being issued and completed on compute hosts. We are working quickly to implement a fix to these hosts, and we will provide an update as soon as the solution is in place.

If you continue experiencing issues or need further assistance, please open a Support ticket from the Linode Manager.
Posted Dec 08, 2025 - 17:13 UTC

Investigating

Our team is investigating an emerging service issue affecting completing jobs issued to compute hosts in multiple regions. We will share additional updates as we have more information.
Posted Dec 08, 2025 - 16:38 UTC
This incident affected: Linode Manager and API.