polars_io::path_utils

Function expand_paths_hive

Source
pub fn expand_paths_hive(
    paths: &[PathBuf],
    glob: bool,
    cloud_options: Option<&CloudOptions>,
    check_directory_level: bool,
) -> PolarsResult<(Arc<[PathBuf]>, usize)>
Expand description

Recursively traverses directories and expands globs if glob is true. Returns the expanded paths and the index at which to start parsing hive partitions from the path.