Module concurrency 

Available on crate feature cloud only.

Adaptive in-flight concurrency controller for cloud IO (Input only).

Admission control for concurrency uses two budgets:

• A (primary) bytes-based budget to model the bandwidth-delay product (BDP)
• A (secondary) count-based budget to limit the number of in-flight requests

The bytes-based budget models the BDP as BDP = BW_max * TTFB_est

Three components cooperate:

• Model: records IO observations and models the network (BW_max, TTFB_est, BDP)
• Regime: state machine driving the admission (Init / RampUp / Stable / ProbeUp)
• Admission: admission control, enforces byte-based + request-based budgets

Structs

ConcurrencyController

ControllerConfig

HeadRttChannel

Windowed round-trip time of 0-byte metadata (HEAD) requests. Diagnostic only, not to be used for BDP estimation.

HeadRttWindow

One control tick’s worth of HeadRttChannel observations.

InFlightBudget

InFlightPermit

InFlightStats

IoSample

Model

Regime

Enums

RegimeState

Functions

get_floor_request_budget

Minimum number of requests concurrently in flight, if demand is there.

get_request_budget

Maximum number of requests concurrently in flight.