polars.io.csv.batched_reader.BatchedCsvReader.next_batches#

BatchedCsvReader.next_batches(n: int) list[DataFrame] | None[source]#

Read n batches from the reader.

These batches will be parallelized over the available threads.

Parameters:
n

Number of chunks to fetch; ideally this is >= number of threads.

Returns:
list of DataFrames

Examples

>>> reader = pl.read_csv_batched(
...     "./pdsh/tables_scale_100/lineitem.tbl",
...     separator="|",
...     try_parse_dates=True,
... )  
>>> reader.next_batches(5)