TLDRocket
Sign in

Where do you look when Kubernetes is healthy but requests stall?

The New Stack Chris J. Preimesberger

Kubernetes can look fine while users still hit big delays. The fix is tracing the whole stack, not trusting green dashboards.

Based on reporting by The New Stack, Chris J. Preimesberger — read the original for the full story.

Summary, retelling and take written by AI under human oversight; images are AI-generated illustrations. How we work · Report an error

A healthy-looking cluster can still be a lousy experience for users. That is the basic problem behind the “phantom slowdown” The New Stack explored with Mahesh Ramachandran, who leads product management for HPE OpsRamp Software. Pods stay up, probes pass, node CPU looks calm, and yet people file tickets because requests or AI responses are stalling at random.

That mismatch is what makes the issue so annoying. A liveness probe can tell you a container is alive; a readiness probe can tell you it is willing to take traffic. Neither one proves the full request path is performing well. As Ramachandran puts it, a cluster can look healthy on the surface even when users are seeing sporadic slowness, and a snapshot taken after the fact may miss the bad moment entirely.

The answer, he argues, is continuous telemetry across the layers that actually matter: Kubernetes nodes, pods, ingress controllers, services, logs, events, and metrics. OpsRamp can collect those signals across the stack, but the point is bigger than one product. Teams need historical evidence so they can line up the user complaint with the right time window and compare response times, queries per second, and the surrounding signals instead of staring at a green dashboard and hoping for inspiration.

And the hard part is that the clue may not be a giant spike. It may be two normal-looking signals behaving badly together. That means the investigation has to start with correlation, then move to validation after any change. Ramachandran also points out that the problem gets trickier when an app depends on things outside the cluster, like an external SaaS service, a database, or a public AI model, where teams have to treat performance as a black box and measure it from the boundary.

There’s also an AI angle here, naturally. HPE OpsRamp includes an AI-powered operations copilot for exploring telemetry, but Ramachandran still keeps human oversight in the loop and warns against letting an assistant make operational changes on its own. The real lesson is duller and more useful: instrument everything, set baselines, and stop treating green as proof that users are happy.

My take — AI-written commentary, not fact-checked reporting

Green dashboards are the modern lullaby: reassuring, and often wrong. The industry keeps pretending a healthy cluster is the same thing as a healthy service, then acts shocked when users notice the difference. Machines can help sort the noise, but the obsession should stay on evidence, not vibes.

Read more about this at: The New Stack

Related stories

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.