Available on crate features
polars-io and cloud only.Expand description
Adaptive in-flight concurrency controller for cloud IO (Input only).
Admission control for concurrency uses two budgets:
- A (primary) bytes-based budget to model the bandwidth-delay product (BDP)
- A (secondary) count-based budget to limit the number of in-flight requests
The bytes-based budget models the BDP as BDP = BW_max * TTFB_est
Three components cooperate:
- Model: records IO observations and models the network (BW_max, TTFB_est, BDP)
- Regime: state machine driving the admission (Init / RampUp / Stable / ProbeUp)
- Admission: admission control, enforces byte-based + request-based budgets
Structs§
Enums§
Functions§
- get_
request_ budget - Maximum number of requests concurrently in flight.