Miscellaneous#

DataFrame.collect_schema()

Get an ordered mapping of column names to their data type.

DataFrame.corr(**kwargs)

Return pairwise Pearson product-moment correlation coefficients between columns.

DataFrame.equals(other, *[, null_equal])

Check whether the DataFrame is equal to another DataFrame.

DataFrame.lazy()

Start a lazy query from this point.

DataFrame.map_rows(function[, return_dtype, ...])

Apply a custom/user-defined function (UDF) over the rows of the DataFrame.

Serialization#

DataFrame.deserialize(source, *[, format])

Read a serialized DataFrame from a file.

DataFrame.serialize([file, format])

Serialize this DataFrame to a file or string in JSON format.