Types & classes — github.com/delta-io/kafka-delta-ingest

CodeHub MCPcopy Create free account

hub / github.com/delta-io/kafka-delta-ingest / types & classes

Types & classes61 in github.com/delta-io/kafka-delta-ingest

⨍ Functions 298◇ Types & classes 61

↓ 3 callersEnumCoercion

src/coercions.rs:19

EnumAutoOffsetReset

The enum to represent 'auto.offset.reset' options.

ClassAvroDeserializer

src/serialization.rs:142

ClassAvroSchemaDeserializer

src/serialization.rs:152

EnumCoercionNode

src/coercions.rs:11

ClassCoercionTree

src/coercions.rs:25

ClassConsumedBuffers

A struct that wraps the data consumed from [`ValueBuffers`] before writing to a [`arrow::record_batch::RecordBatch`].

src/value_buffers.rs:117

ClassDataArrowWriter

Writes messages to an underlying arrow buffer.

src/writer.rs:183

ClassDataWriter

Writes messages to a delta lake table.

src/writer.rs:174

EnumDataWriterError

src/writer.rs:55

ClassDeadLetter

src/dead_letters.rs:27

InterfaceDeadLetterQueue

src/dead_letters.rs:154

EnumDeadLetterQueueError

src/dead_letters.rs:100

ClassDeadLetterQueueOptions

Options that should be passed to `dlq_from_opts` to create the desired [DeadLetterQueue] instance.

src/dead_letters.rs:136

ClassDefaultDeserializer

src/serialization.rs:99

ClassDeltaSinkDeadLetterQueue

Implementation of the [DeadLetterQueue] trait that writes dead letters to a delta table. NOTE: The delta table where dead letters are written must be

src/dead_letters.rs:240

src/transforms.rs:237

ClassInMemoryWriteableCursor

src/cursor.rs:114

EnumIngestError

ClassIngestMetrics

src/metrics.rs:24

EnumIngestMetricsError

src/metrics.rs:16

ClassIngestOptions

ClassIngestProcessor

Holds state and encapsulates functionality required to process messages and write to delta.

ClassInvalidTypeError

Error thrown from custom functions registered in the jmespath Runtime

src/transforms.rs:35

ClassJsonDeserializer

src/serialization.rs:156

ClassKafkaContext

Implements rdkafka [`ClientContext`] to handle rebalance events sent to the rdkafka [`Consumer`].

src/lib.rs:1230

EnumKafkaMetaProperty

src/transforms.rs:310

ClassKafkaPropertySyntaxError

src/main.rs:272

ClassLagMetrics

Struct representing aggregate lag metrics calculated from a vector of partition lags.

src/metrics.rs:304

ClassLoggingDeadLetterQueue

src/dead_letters.rs:205

EnumMessageDeserializationError

InterfaceMessageDeserializer

src/serialization.rs:22

ClassMessageDeserializerFactory

src/serialization.rs:29

EnumMessageFormat

EnumMessageTransform

src/transforms.rs:318

tests/offset_tests.rs:327

tests/schema_update_tests.rs:11

tests/schema_update_tests.rs:17

ClassNoopDeadLetterQueue

Default implementation of [DeadLetterQueue] which does nothing. This is used as the default to avoid forcing users to setup additional infrastructure

src/dead_letters.rs:188

ClassPartitionAssignment

src/lib.rs:1188

EnumRebalanceAction

Indicates whether a rebalance signal should simply skip the currently consumed message, or clear state and skip.

EnumRebalanceSignal

src/lib.rs:1181

EnumSchemaSource

EnumSchemaSourceError

src/main.rs:278

ClassSliceableCursor

A SliceableCursor lifted from the legacy parquet implementation

src/cursor.rs:8

ClassSoeAvroDeserializer

src/serialization.rs:146

src/metrics.rs:223

tests/delta_partitions_tests.rs:15

tests/buffer_flush_tests.rs:151

tests/deserialization_tests.rs:343

tests/dead_letter_tests.rs:21

tests/offset_tests.rs:17

ClassTestMsgNested

tests/dead_letter_tests.rs:16

tests/helpers/mod.rs:564

EnumTransformError

src/transforms.rs:14

ClassTransformSyntaxError

src/main.rs:266

ClassTransformer

Transforms JSON values deserialized from a Kafka topic.

src/transforms.rs:374

ClassValueBuffer

src/value_buffers.rs:79

ClassValueBuffers

src/value_buffers.rs:7

src/transforms.rs:323

EnumWriteOffsetsError

src/offsets.rs:13