Struct StorageBackend 

pub struct StorageBackend {
    pub object_store: Arc<dyn ObjectStore>,
    pub base_path: String,
    pub original_uri: String,
}

Native object-store storage handles shared by catalog, session, and stream writers.

Fields

object_store: Arc<dyn ObjectStore>

object_store adapter used by DataFusion, Parquet, and existing persistence code.

base_path: String

Path prefix inside the object store for URI schemes that carry bucket/container roots.

original_uri: String

Normalized URI used to create this backend.

Implementations

impl StorageBackend

pub fn datafusion_root_url(&self) -> Result<Url>

Returns the root URL DataFusion should associate with this object store.

Delta and external catalog integrations use object-store-relative paths after the object store has already rooted the operator at the catalog path. Registering the object store at the URI authority root keeps those relative table paths stable across local, memory, and cloud storage.

Errors

Returns an error if the original URI cannot be converted into a DataFusion object-store URL.

pub async fn list_directory_stems( &self, subdirectory: &str, ) -> Result<Vec<String>>

Lists immediate child directory stems below a storage-relative subdirectory.

This is used by catalog data and run-session discovery so local, memory, and cloud backends share one object-store listing path.

Errors

Returns an error if the object-store listing fails.

pub async fn list_files( &self, subdirectory: &str, suffix: Option<&str>, ) -> Result<Vec<String>>

Lists files below a storage-relative subdirectory.

Errors

Returns an error if the object-store listing fails.

pub async fn write_run_manifest( &self, kind: &str, instance_id: &str, status: &str, empty: bool, ) -> Result<()>

Writes a manifest for a run under the catalog session root.

Errors

Returns an error if manifest serialization or storage writing fails.

pub async fn write_current_run_manifest( &self, kind: &str, instance_id: &str, status: &str, empty: bool, ) -> Result<()>

Writes a manifest at the backend root, for writers rooted directly at one run directory.

Errors

Returns an error if manifest serialization or storage writing fails.

pub async fn read_run_manifest( &self, kind: &str, instance_id: &str, ) -> Result<Option<RunManifest>>

Reads a run manifest from catalog session storage.

Errors

Returns an error if storage reading or manifest deserialization fails.

pub async fn list_run_ids(&self, kind: &str) -> Result<Vec<String>>

Lists run IDs from directories and manifests for one session kind.

Errors

Returns an error if storage listing or manifest reading fails.

pub async fn list_run_ids_for_kinds( &self, kinds: &[&str], ) -> Result<Vec<String>>

Lists run IDs from directories and manifests for multiple session kind aliases.

Errors

Returns an error if storage listing or manifest reading fails.

Trait Implementations

impl Clone for StorageBackend

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.