An implementation of {@link HoodieClientInitCallback} that adds field ID metadata to the schema. When used with {@link HoodieAvroWriteSupportWithField

Class that converts Avro Schema {@link Schema} to Canonical Schema {@link InternalSchema} and vice-versa. This conversion is fully reversible and ther

Catalogs are responsible for the management of and providing access to the metadata associated with a given set of Tables, typically within the contex

A client for converting the table with tableIdentifier {@link CatalogTableIdentifier} in source catalog to SourceTable object {@link SourceTable}, can

This class is designed to encapsulate a set of partition values and the corresponding storage location where the data for this partition is stored.

Partition Event captures any partition that needs to be added or updated.

Defines operations for managing partitions in an external catalog. <p>This interface provides methods to perform CRUD (Create, Read, Update, Delete)

Defines methods to synchronize all partitions from the storage to the catalog. Implementations of this interface will handle the logic for syncing par

Exception thrown when refresh operation (updating table format metadata) in catalog fails.

Provides the functionality to sync metadata from InternalTable to multiple target catalogs

An interface for syncing {@link InternalTable} object to {@link TABLE} object defined by the catalog. @param <TABLE>

CatalogSyncException should be used for failures that occur while performing {@link org.apache.xtable.spi.sync.CatalogSyncClient} operations

Represents status for catalog sync status operation

The interface for creating/updating catalog table object, each catalog can have its own implementation that can be plugged in.

Represents a catalog table identifier in a multi-level catalog system.

Default constants for supported catalog types. @since 0.1

Utility methods used by CatalogSync.

Use the source {@link CLIENT} to extract the canonical representation of delta changes since the specified {@link INSTANT} @param <CLIENT> Table clie

Captures column level statistics for a field. @since 0.1

Represents a collection of commits that are awaiting processing and syncing w.r.t. a sync instant, say T. These commits include three types of commits

Parses the InternalPartitionFields from a configured list of specs with the format path:type:format for date types or path:type for value types.

Responsible for completing the entire lifecycle of the sync process given {@link ConversionConfig}. This is done in three steps, <ul> <li>1. Extrac

Service for managing table format conversions. <p>It supports formats such as ICEBERG, HUDI, and DELTA. The conversion process involves creating a so

A client that provides the major functionality for extracting the state at a given instant in a source system. The client uses {@link Instant} to repr

Provides the functionality to provide an instance of the {@link ConversionSource} for a given table format. The provider can create a new instance of

A client that provides the major functionality for syncing changes to a target system.

DataFileIterator lets the consumer iterate over the files of a table.

Strategy used/required to lay out data in the table. @since 0.1

Factory class for creating and configuring instances of {@link GlueClient} with settings provided by {@link GlueCatalogConfig}. <p>This factory is re

A concrete implementation of {@link ConversionSourceProvider} for Delta Lake table format.

A utility class for Delta conversion.

DeltaDataFileExtractor lets the consumer iterate over partitions.

Delta specific table operations for Glue catalog sync

Cache store for storing incremental table changes in the Delta table.

DeltaPartitionExtractor handles extracting partition columns, also creating generated columns in the certain cases. It is also responsible for Partiti

Converts between Delta and InternalTable schemas. Some items to be aware of: <ul> <li>Delta schemas are represented as Spark StructTypes which do n

DeltaStatsExtractor extracts column stats and also responsible for their serialization leveraging {@link DeltaValueConverter}.

Extracts {@link InternalTable} canonical representation of a table at a point in time for Delta.

DeltaValueConverter is specialized in (de)serializing column stats and partition values depending on the data type and partition transform type.

Defines the configuration for an external catalog, user needs to populate at-least one of {@link ExternalCatalogConfig#catalogType} or {@link External

Defines a reference to a table in a particular format.

Supported FileFormat list @since 0.1

Captures a file level statistics. @since 0.2

Holds the collection of files that represent the difference between two states/commits/snapshots of a table with respect to the data files. Between an

Configurations for setting up Glue client and running Glue catalog operations

AWS Glue implementation for CatalogSyncClient for registering InternalTable in Glue

Utils class to fetch details about Glue table

Abstract factory for creating {@link GlueClient} instances configured with {@link GlueCatalogConfig} settings.

Represents a hierarchical table identifier, often including catalog, database (or schema), and table names. Some catalogs may omit the catalog name.

An extension of the standard {@link HoodieAvroWriteSupport} that adds field IDs to the parquet schema. When used with {@link AddFieldIdsClientInitCall