All posts from: December 2019

Unthrottled: How a Valid Fix Becomes a Regression

This post is the second in a two-part series. In a previous post, I outlined how we recognized a major throttling issue involving CFS-Cgroup bandwidth control. To uncover the problem, we created a reproducer and used git bisect to identify the causal commit. But that commit appeared completely valid, which added even more complications. In […]

Read the full article »

Unthrottled: Fixing CPU Limits in the Cloud

This post is the first in a two-part series. This year, my teammates and I solved a CPU throttling issue that affects nearly every container orchestrator with hard limits, including Kubernetes, Docker, and Mesos. In doing so, we lowered worst-case response latency in one of Indeed’s applications from over two seconds to 30 milliseconds. In […]

Read the full article »