Skip to main content

Module from_iterator_par

Module from_iterator_par 

Source
Expand description

Parallel iterator collection into ChunkedArray<T>

Two strategies:

  • collect_into_linked_list* — for iterators of unknown length. Folds into one accumulator per rayon task and concatenates, so the resulting chunk count equals the task count and varies with thread count and stealing. optional_rechunk is the only backstop.

  • collect_*_par — for callers with O(1) random access and a known output length. Writes into a single preallocated buffer, so the result is always one chunk regardless of how rayon split the work. Preferable.

Traits§

ChunkedCollectParIterExt
FromParIterWithDtype

Functions§

list_from_par_iter
try_list_from_par_iter