Latency
12 items tagged with "latency"
Patterns2
Refresh-Ahead Cache
A caching strategy that proactively reloads hot entries before they expire, so reads of popular keys never pay miss latency.
Timeout
Bounds how long a caller waits for an operation, freeing resources and surfacing failures fast instead of blocking indefinitely on a slow or hung dependency.
Benchmarks6
netperf Network Benchmark
Network performance tool measuring both bulk-transfer throughput and request/response transaction rates, used to characterize latency-sensitive workloads.
Cold-Start Latency Benchmark
Measures the added latency when a serverless function or container must initialize from scratch before serving its first request after being idle.
API P99 Latency Benchmark
Measures tail latency, the response time at the 99th percentile, to capture worst-case API responsiveness that averages hide and that users feel most.
Serverless Cold-Start Latency Benchmark
Measures the added latency when a serverless function must initialize a new execution environment before handling a request, across runtimes and platforms.
CDN Latency Benchmark
Measures content delivery network performance from many geographic vantage points, including edge latency, cache hit ratio, and origin offload.
Kubernetes Scheduling Latency Benchmark
Measures how quickly the Kubernetes scheduler places pods on nodes and how the control plane scales as pod, node, and churn counts grow.
Glossaries2
UDP
UDP (User Datagram Protocol) is a lightweight, connectionless transport protocol that sends datagrams without delivery guarantees, favoring low latency over reliability.
Latency
Latency is the time delay between a request being made and the corresponding response beginning to arrive, typically measured as round-trip time in milliseconds.