Topic67 problems· 8 reviewed

DNS and Routing

67 incident problems about DNS and Routing. Start with the reviewed ones.

All problems (67)

NETWORK-030Blue-green cutover misses webhook callback allowlistThe new stack goes live, but one callback provider still points at the old address because its allowlist and DNS cutover are out of sync.NetworkIntermediate19 minPro NETWORK-022Internal DNS resolves the old targetMost clients pick up the new destination, but a subset stays on the stale IP because resolver behavior is inconsistent.NetworkIntermediate21 minPro NETWORK-029Conntrack eviction hurts new connections before CPU looks busyConntrack eviction hurts new connections (Resource Exhaustion) is a hands-on troubleshooting drill. The host still has spare CPU, but new flows fail because connection tracking entries are evicted too aggressively. DNS and Routing needs to be checked by narrowing scope, recent...NetworkAdvanced29 minPro NETWORK-025HTTP keepalive pool sends requests to drained backendHTTP keepalive pool sends requests to drained backend is a hands-on troubleshooting drill. A backend has been removed from the balancer, but idle pooled connections continue sending requests there for a while. DNS and Routing needs to be checked by narrowing scope, recent chan...NetworkIntermediate20 minPro NETWORK-015After adding a WAF rule, only certain JSON requests return 403Reproduces and analyzes a situation where most requests are fine but only a specific payload pattern is caught by the security rule.NetworkIntermediate21 minPro NETWORK-012After an Anycast DNS switch, only a certain region keeps getting the old IPA situation where the global switch is done but cache and regional resolver differences send only some users to the old endpoint.NetworkIntermediate23 minPro NETWORK-1619A resolver update is correct and one site still gets stale answersOne site still gets stale DNS answers after a resolver update.NetworkIntermediate9 minPro