Latency lags bandwidth. Not just by a constant factor, either. Over time, bandwidth increases with the square of latency.
Powerful computer engineering maxim. It’s held true for at least the last 35-40 years, across network, disk, memory, CPU. Patterson’s 2004 article is a classic. It’s had a deep impact on me; I still think about it regularly.
Another take on this:
– Tim Sweeney
Interesting stats on this from the people who run AWS S3. Between 2001 and 2021, traditional spinning hard drives have improved by:
…but latency has only improved 150x. Seek time hasn’t improved at all!