"The strategy to shield the core is threefold: Absorb the Burst by handling sudden traffic spikes before they reach core systems; Control the Flow that applies fairness, rate limits and admission control; and Protect the Core to keep critical services stable during demand spikes."
"The responsibilities of the Edge Shield include: a Cache that serves requests without hitting the origin; a Queue to absorb sudden traffic bursts; and a Filter to detect bots and invalid traffic."
"Using the Cache as a resilience mechanism solves the issues of: fewer cache responses as a function of increasing failures; more origin traffic when there are fewer cache hits; and an increase in failures when there is an increase in traffic."
"Parra maintained that everything changes with a combined use of the cache with rate limiting. The service remains stable, the cache warms up safer, and there is an overall improvement in system resilience."
SeatGeek faces significant traffic spikes, termed 'traffic stampedes,' which can overwhelm systems. The Noisy Neighbor Problem and Scaling Gap are critical challenges. To shield the core, a threefold strategy is employed: Absorb the Burst, Control the Flow, and Protect the Core. The Edge Shield includes a Cache, Queue, and Filter to manage traffic effectively. Combining cache with rate limiting enhances stability and resilience, ensuring systems can handle increased demand without failure.
Read at InfoQ
Unable to calculate read time
Collection
[
|
...
]