Struct PolarsObjectStore

pub struct PolarsObjectStore(/* private fields */);

Available on crate feature cloud only.

Polars specific wrapper for Arc<dyn ObjectStore> that limits the number of concurrent requests for the entire application.

Implementations

impl PolarsObjectStore

pub fn new(store: Arc<dyn ObjectStore>) -> Self

pub async fn get_range( &self, path: &Path, range: Range<usize>, ) -> PolarsResult<Bytes>

pub async fn get_ranges_sort<K: TryFrom<usize, Error = impl Debug> + Hash + Eq, T: From<Bytes>>( &self, path: &Path, ranges: &mut [Range<usize>], ) -> PolarsResult<PlHashMap<K, T>>

Fetch byte ranges into a HashMap keyed by the range start. This will mutably sort the ranges slice for coalescing.

Panics

Panics if the same range start is used by more than 1 range.

pub async fn download(&self, path: &Path, file: &mut File) -> PolarsResult<()>

pub async fn head(&self, path: &Path) -> PolarsResult<ObjectMeta>

Fetch the metadata of the parquet file, do not memoize it.

Trait Implementations

impl Clone for PolarsObjectStore

fn clone(&self) -> PolarsObjectStore

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PolarsObjectStore

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.