Skip to main content

Module migration

Module migration 

Source
Expand description

Target-neutral planning and reading for legacy Parquet catalog migration.

Structs§

CatalogMigrationPlan
Complete read-only result of source discovery and schema preflight.
CatalogMigrationReport
Structured result shared by Parquet and Delta migration entry points.
CatalogMigrationTypeReport
Migration counters for one current target type.
PlannedMigrationFile
One source file accepted by migration preflight.
PreparedMigrationPart
Batches from one source file that share one resolved identifier.
SchemaConflict
Incompatible final schemas targeting one output table.
SchemaConflictExample
One schema and example source path in a target-table conflict.
UnmigratedFile
One source path excluded from migration.
UnresolvedSchema
One source file whose schema needs an unregistered transcoder.

Enums§

IdentifierSource
How a migrated identifier was resolved.

Constants§

DEFAULT_MIGRATION_COMMIT_ROWS
Default maximum number of source rows written in one open-catalog migration commit.

Traits§

ParquetCatalogSource
Object-store source used to plan and read a legacy Parquet migration.

Functions§

build_catalog_migration_plan
Enumerates and resolves every source leaf file without writing a target.
parse_storage_option
Parses a storage option expressed as key=value.
prepare_migration_parts
Resolves identifiers and groups batches from one source file.
read_planned_migration_file
Reads, normalizes, and transcodes one planned source file.