meshStack SaaS - Degraded Service (HTTP 503 Errors) 2026-04-20
J
Johannes Rudolph
We are currently observing elevated error rates affecting managed meshStack instances in our SaaS service.
meshStack SaaS is hosted on Google Cloud Platform (GCP) on GKE.
This behavior is primarily linked to a surge in infrastructure maintenance events in GKE.
Technical Details
Our engineering team has identified two primary external factors contributing to this instability:
- CVE-2026-23268 (CrackArmor) Patching: Google is currently rolling out kernel-level mitigations for "CrackArmor" vulnerabilities. This has resulted in an increased frequency of node reboots and live migrations. On our current N2 nodes we see long provisioning times for new nodes to replace failed hosts.
- While our service is designed to withstand these maintenance events, customers may observe intermittent errors. Since this is the second time node migrations have impacted our service, we are looking at long term solutions
Affected Components
- All meshStack SaaS services (meshPanel, meshStack API)
- Customers hosted on our GCP-based SaaS infrastructure
Status and Next Steps
To stabilize the environment and reduce the impact of these maintenance events, we are taking the following actions:
- Node Type Migration: We are accelerating a migration of affected workloads from N2 instances to more modern instance types. This move is designed to provide better stability during maintenance and decouple our infrastructure from any hardware-specific issues seen on the N2 family.
- Review of node pool sizing: we are allocating more headroom for maintenance events
Timeline
We will provide the next update on our instance migration process by April 24th.