Skip to main content

Module _internal

Module _internal 

Source
Available on crate feature polars-io only.

Functions§

calc_prefilter_cost
canonicalize_parquet_maps
Resolve duplicate keys in every Map nested inside a decoded parquet column.
ensure_matching_dtypes_if_found
Utility to ensure the dtype of the column in current_schema matches the dtype in schema if that column exists in schema.
to_deserializer
to_dictionary_codes
Decodes a flat String column chunk as codes into its dictionary, if it has a dictionary page, every data page is dictionary-encoded and accept(num_rows, dict_len, dict_bytes) holds for the number of rows the filter keeps (all of the chunk’s for a predicate, whose result isn’t known yet) and the number and uncompressed size of the dictionary values. Returns None otherwise, without decoding anything.