Skip to main content

Module concurrency

Module concurrency 

Source
Available on crate features polars-io and cloud only.
Expand description

Adaptive in-flight concurrency controller for cloud IO (Input only).

Admission control for concurrency uses two budgets:

  • A (primary) bytes-based budget to model the bandwidth-delay product (BDP)
  • A (secondary) count-based budget to limit the number of in-flight requests

The bytes-based budget models the BDP as BDP = BW_max * TTFB_est

Three components cooperate:

  • Model: records IO observations and models the network (BW_max, TTFB_est, BDP)
  • Regime: state machine driving the admission (Init / RampUp / Stable / ProbeUp)
  • Admission: admission control, enforces byte-based + request-based budgets

Structs§

ConcurrencyController
ControllerConfig
InFlightBudget
InFlightPermit
InFlightStats
IoSample
Model
Regime

Enums§

RegimeState

Functions§

get_request_budget
Maximum number of requests concurrently in flight.