Skip to main content

Module io

Module io 

Source

Re-exports§

pub use crate::common::paths::normalize_path_to_uri;

Functions§

combine_parquet_files_from_object_store
Combines multiple Parquet files from object store
create_object_store_from_path
Creates an object store from a URI string with optional storage options.
min_max_from_parquet_metadata_object_store
Extracts the minimum and maximum i64 values for the specified column_name from a Parquet file’s metadata in object store.
read_parquet_from_object_store
Reads a Parquet file from an object store and returns all record batches plus the Arrow schema from the builder. The builder’s schema includes metadata restored from the file’s ARROW:schema key_value_metadata; use it for decoding instead of each batch’s schema (which has metadata stripped).
read_parquet_schema_from_object_store
Reads only the Arrow schema (including key/value metadata) of a Parquet object.
write_batches_to_object_store
Writes multiple RecordBatch items to an object store URI, with optional compression, row group sizing, and key_value_metadata (e.g. for instrument type_name so it survives roundtrip).