Habitat: how OpenAI scaled online storage to 70M+ requests per second
Architecture lessons from Habitat: from a Python library to a distributed service, asyncio tail latency, LIFO/FIFO pooling, Envoy, deliberately constrained APIs, and a Rust migration.