Struct PolarsObjectStore

pub struct PolarsObjectStore { /* private fields */ }

Available on crate feature polars-io only.

Polars wrapper around [ObjectStore] functionality. This struct is cheaply cloneable.

Implementations

impl PolarsObjectStore

pub async fn to_dyn_object_store(&self) -> Arc<dyn ObjectStore>

Gets the underlying [ObjectStore] implementation.

pub async fn rebuild_inner( &self, from_version: &Arc<dyn ObjectStore>, ) -> Result<Arc<dyn ObjectStore>, PolarsError>

pub async fn try_exec_rebuild_on_err<Fn, Fut, O>( &self, func: Fn, ) -> Result<O, PolarsError>

where Fn: FnMut(&Arc<dyn ObjectStore>) -> Fut, Fut: Future<Output = Result<O, PolarsError>>,

impl PolarsObjectStore

pub async fn get_range( &self, path: &Path, range: Range<usize>, ) -> Result<Bytes, PolarsError>

pub async fn get_ranges_sort<K, T>( &self, path: &Path, ranges: &mut [Range<usize>], ) -> Result<HashMap<K, T, RandomState>, PolarsError>

where K: TryFrom<usize, Error = impl Debug> + Hash + Eq, T: From<Bytes>,

Fetch byte ranges into a HashMap keyed by the range start. This will mutably sort the ranges slice for coalescing.

Panics

Panics if the same range start is used by more than 1 range.

pub async fn download( &self, path: &Path, file: &mut File, ) -> Result<(), PolarsError>

pub async fn head(&self, path: &Path) -> Result<ObjectMeta, PolarsError>

Fetch the metadata of the parquet file, do not memoize it.

Trait Implementations

impl Clone for PolarsObjectStore

fn clone(&self) -> PolarsObjectStore

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PolarsObjectStore

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.