Miscellaneous#

LazyFrame.cache()

Cache the result once the execution of the physical plan hits this node.

LazyFrame.collect(*[, type_coercion, ...])

Materialize this LazyFrame into a DataFrame.

LazyFrame.collect_async()

Collect DataFrame asynchronously in thread pool.

LazyFrame.fetch([n_rows, type_coercion, ...])

Collect a small number of rows for debugging purposes.

LazyFrame.lazy()

Return lazy representation, i.e. itself.

LazyFrame.map(function, *[, ...])

Apply a custom function.

LazyFrame.map_batches(function, *[, ...])

Apply a custom function.

LazyFrame.pipe(function, *args, **kwargs)

Offers a structured way to apply a sequence of user-defined functions (UDFs).

LazyFrame.profile(*[, type_coercion, ...])

Profile a LazyFrame.

Read/write logical plan#

LazyFrame.deserialize(source)

Read a logical plan from a JSON file to construct a LazyFrame.

LazyFrame.from_json(json)

Read a logical plan from a JSON string to construct a LazyFrame.

LazyFrame.read_json(source)

Read a logical plan from a JSON file to construct a LazyFrame.

LazyFrame.serialize()

Serialize the logical plan of this LazyFrame to a file or string in JSON format.

LazyFrame.write_json()

Serialize the logical plan of this LazyFrame to a file or string in JSON format.