Struct PolarsObjectStore

pub struct PolarsObjectStore(/* private fields */);

Available on crate feature polars-io only.

Polars specific wrapper for Arc<dyn ObjectStore> that limits the number of concurrent requests for the entire application.

Implementations

impl PolarsObjectStore

pub fn new(store: Arc<dyn ObjectStore>) -> PolarsObjectStore

pub async fn get_range( &self, path: &Path, range: Range<usize>, ) -> Result<Bytes, PolarsError>

pub async fn get_ranges_sort<K, T>( &self, path: &Path, ranges: &mut [Range<usize>], ) -> Result<HashMap<K, T, RandomState>, PolarsError>

where K: TryFrom<usize, Error = impl Debug> + Hash + Eq, T: From<Bytes>,

Fetch byte ranges into a HashMap keyed by the range start. This will mutably sort the ranges slice for coalescing.

Panics

Panics if the same range start is used by more than 1 range.

pub async fn download( &self, path: &Path, file: &mut File, ) -> Result<(), PolarsError>

pub async fn head(&self, path: &Path) -> Result<ObjectMeta, PolarsError>

Fetch the metadata of the parquet file, do not memoize it.

Trait Implementations

impl Clone for PolarsObjectStore

fn clone(&self) -> PolarsObjectStore

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PolarsObjectStore

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.