Scenario
Service discovery is accurate and the client keeps dialing endpoints that no longer exist. Normal traffic masked the issue until the standby or alternate path became active under rehearsal conditions.
A headless Service gives every pod address while the client library still randomizes from a stale cached subset after scale-down during a failover rehearsal
Service discovery is accurate and the client keeps dialing endpoints that no longer exist. Normal traffic masked the issue until the standby or alternate path became active under rehearsal conditions.
What to check first
- Identify the primary failure signal in the Discovery Updated, Client Endpoint Set Stayed Old scenario.
- Separate visible symptoms from the underlying technical dependency.
- Describe the safest recovery path and the follow-up prevention work.
Checking checklist
- Summarize the current impact and the last known change.
- Collect direct evidence from logs, runtime state, and configuration before changing anything.
- Separate immediate recovery from permanent prevention work.
Recovery and prevention
Choose the smallest safe recovery action first, then record the prevention work that reduces repeat incidents.
Questions worth viewing together
No. Keep commands, logs, file names, APIs, and product names unchanged, then explain the reasoning in the selected UI language.
State the root cause, the evidence that supports it, and the safest recovery direction.
The source scenario is treated as an incident artifact. Guidance, checklist, hints, and explanations can be localized around it.
Similar cases seen in the field