Functions — github.com/Mooncake-Labs/moonlink

hub / github.com/Mooncake-Labs/moonlink / functions

Functions2,717 in github.com/Mooncake-Labs/moonlink

⨍ Functions 2,717◇ Types & classes 409

↓ 4 callersFunctioncreate_opendal_operator

Util function to create opendal operator from filesystem config.

src/moonlink/src/storage/filesystem/accessor/operator_utils.rs:104

↓ 4 callersFunctioncreate_table_event_syncer

Create table event manager sender and receiver.

src/moonlink/src/event_sync.rs:39

↓ 4 callersFunctioncreate_table_handler_timers

Util function to create table handler timers, with default config.

src/moonlink/src/table_handler_timer.rs:17

↓ 4 callersFunctioncreate_test_table

This file contains testing logic which is general to all types of catalogs. Test util function to create a new table.

src/moonlink/src/storage/table/iceberg/catalog_test_impl.rs:17

↓ 4 callersMethoddelete

(&mut self, row: MoonlinkRow, lsn: u64)

src/moonlink/src/storage/mooncake_table.rs:1281

↓ 4 callersMethoddelete

(&self)

src/moonlink/src/storage/filesystem/accessor/filesystem_accessor_chaos_wrapper.rs:77

↓ 4 callersMethoddelete_if_exists

(&mut self, row: MoonlinkRow, lsn: u64)

src/moonlink/src/storage/mooncake_table.rs:1286

↓ 4 callersMethoddelete_row

(&mut self, row_idx: usize)

src/moonlink/src/storage/mooncake_table/delete_vector.rs:53

↓ 4 callersMethodequals_record_batch_at_offset

Check whether the `offset`-th of the given record batch matches the current moonlink row. It's worth noting `batch` contains all columns (aka, before

src/moonlink/src/row/moonlink_row.rs:195

↓ 4 callersMethodextract_identity_for_key

(&self, row: &MoonlinkRow)

src/moonlink/src/row/moonlink_row.rs:321

↓ 4 callersFunctionfield_with_id

(name: &str, dt: DataType, nullable: bool, ids: &mut i32)

src/moonlink_service/src/otel/otel_schema.rs:12

↓ 4 callersMethodfinalize_snapshot

Finalize the snapshot transaction on success or failure.

src/moonlink_connectors/src/pg_replicate/postgres_source.rs:469

↓ 4 callersMethodforce_index_merge_and_sync

Force an index merge operation, and block wait its completion.

src/moonlink/src/table_handler/test_utils.rs:297

↓ 4 callersMethodget_cur_xact_id

Get transaction id to set for both streaming and non-streaming transactions.

src/moonlink/src/table_handler/chaos_test.rs:309

↓ 4 callersFunctionget_directory_under_base

Get directory path under the given base directory.

src/moonlink_backend/src/file_utils.rs:16

↓ 4 callersMethodget_event_sender_for

(&mut self, table_id: SrcTableId)

src/moonlink_connectors/src/pg_replicate/moonlink_sink.rs:183

↓ 4 callersFunctionget_expected_remap_for_two_batches_in_one_file

Test util function to get the possible expected remap. Precondition: data files are generated by `create_test_batch_1` and `create_test_batch_2`.

src/moonlink/src/storage/compaction/test_utils.rs:289

↓ 4 callersMethodget_live_wal_files_tracker

(&self)

src/moonlink/src/storage/wal.rs:357

↓ 4 callersFunctionget_moonlink_table_config

Create a moonlink table config for test.

src/moonlink_metadata_store/src/sqlite/tests.rs:73

↓ 4 callersFunctionget_only_index_block_filepath

Test util to get all index block file ids for the table, and assert there's only one file.

src/moonlink/src/storage/mooncake_table/table_accessor_test_utils.rs:90

↓ 4 callersFunctionget_only_puffin_blob_ref_from_table

Test util to get the only puffin blob ref for the given mooncake table.

src/moonlink/src/storage/mooncake_table/table_accessor_test_utils.rs:121

↓ 4 callersFunctionget_parquet_metadata

================================ get_parquet_metadata ================================ Get parquet metadata and file size for the given local parquet

src/moonlink/src/storage/table/iceberg/parquet_utils.rs:251

↓ 4 callersFunctionget_random_table

Test util function to get a random table.

src/moonlink/src/storage/table/iceberg/glue_catalog_test_utils.rs:42

↓ 4 callersFunctionget_serialized_table_config

Util function to create a table creation config by directory.

src/moonlink_backend/tests/common.rs:443

↓ 4 callersMethodget_status

(&self)

src/moonlink_rpc/src/error.rs:68

↓ 4 callersMethodget_table_schema

Get the current mooncake table schema. If the requested database or table doesn't exist, return [`TableNotFound`] error.

src/moonlink_backend/src/lib.rs:310

↓ 4 callersFunctionget_unique_table_file_id

Test util function to get unique table file id.

src/moonlink/src/storage/mooncake_table/test_utils_commons.rs:33

↓ 4 callersMethodhash

(&self, state: &mut H)

src/moonlink/src/row/moonlink_type.rs:39

↓ 4 callersFunctionids_from_state_with_deletes

(read_state: &ReadState)

src/moonlink_backend/tests/common.rs:338

↓ 4 callersFunctionimport_file_indices_to_cache

Import the given file indices into cache, and return evicted files to delete.

src/moonlink/src/storage/index/cache_utils.rs:40

↓ 4 callersMethodinsert_file_index

Insert a file index (batch of on-disk records) This adds a new file index to the collection of file indices

src/moonlink/src/storage/index/hash_index.rs:29

↓ 4 callersMethodinsert_memory_index

Insert a memory index (batch of in-memory records)

src/moonlink/src/storage/index/hash_index.rs:18

↓ 4 callersMethodinto_parts

(self)

src/moonlink/src/storage/compaction/compactor.rs:73

↓ 4 callersMethodis_captured_in_iceberg_snapshot

Checks if a transaction is captured in the iceberg snapshot. Sometimes this may be called after we have calculated the lowest file to keep for the sna

src/moonlink/src/storage/wal.rs:257

↓ 4 callersMethodis_empty

Return whether the payload is empty.

src/moonlink/src/storage/mooncake_table/table_snapshot.rs:52

↓ 4 callersMethodlist_namespaces

( &self, parent: Option<&NamespaceIdent>, )

src/moonlink/src/storage/table/iceberg/file_catalog.rs:267

↓ 4 callersFunctionmake_struct_schema

()

src/moonlink_connectors/src/rest_ingest/json_converter.rs:348

↓ 4 callersFunctionmoonlink_row_to_proto

(row: MoonlinkRow)

src/moonlink/src/row/proto_converter.rs:12

↓ 4 callersFunctionparse_timestamp

Parse an RFC3339/ISO8601 timestamp and normalize to UTC Follows the same behavior as pg -> moonlink: canonicalize to UTC timezone

src/moonlink_connectors/src/rest_ingest/datetime_utils.rs:43

↓ 4 callersMethodperform_index_merge

Perform index merge, whose completion will be notified separately in async style.

src/moonlink/src/storage/mooncake_table.rs:1369

↓ 4 callersFunctionpostgres_schema_to_moonlink_schema

Convert a PostgreSQL TableSchema to an Arrow Schema

src/moonlink_connectors/src/pg_replicate/util.rs:157

↓ 4 callersFunctionprepare_state_4

Prepare state 4 for read usage: no remote, local, in use

src/moonlink/src/storage/mooncake_table/data_file_state_tests.rs:310

↓ 4 callersMethodprocess_rest_event

Process a REST event and send appropriate table events This is the main entry point for REST event processing, similar to moonlink_sink's process_cdc_

src/moonlink_connectors/src/rest_ingest/moonlink_rest_sink.rs:97

↓ 4 callersMethodregister_table_notify

Register event completion notifier. Notice it should be registered only once, which could be used to notify multiple events.

src/moonlink/src/storage/mooncake_table.rs:655

↓ 4 callersMethodset_file_indices_merge_res

Set file indices merge result, which will be sync-ed to mooncake and iceberg snapshot in the next periodic snapshot iteration.

src/moonlink/src/storage/mooncake_table.rs:758

↓ 4 callersMethodset_snapshot_lsn

(&self, lsn: u64)

src/moonlink/src/table_handler/test_utils.rs:396

↓ 4 callersMethodsource

Returns the underlying source error for accessing structured information. # Example ```ignore if let Some(source) = error_struct.source() { if let So

src/moonlink_error/src/error.rs:111

↓ 4 callersMethodsubscribe_flush_lsn

Subscribe to flush LSN updates.

src/moonlink/src/storage/mooncake_table/table_event_manager.rs:40

↓ 4 callersFunctionterminate_replication_new_conn

()

src/moonlink_backend/tests/test_replication_recovery.rs:14

↓ 4 callersFunctionvalidate_files_to_delete_after_persistence

======================== Test util function ======================== Validate files to delete after iceberg persistence. # Arguments delete_index_a

src/moonlink/src/storage/mooncake_table/data_file_state_tests.rs:91

↓ 4 callersFunctionvalidate_state_1

================================ State validation function ================================ Validate state 1: remote, no local, not used

src/moonlink/src/storage/mooncake_table/data_file_state_tests.rs:345

↓ 4 callersFunctionverify_iceberg_content

Test util function to validate iceberg content.

src/moonlink/src/storage/mooncake_table/validation_test_utils.rs:232

↓ 4 callersFunctionverify_recovered_mooncake_snapshot

Test util function to validate mooncake snapshot result.

src/moonlink/src/storage/mooncake_table/validation_test_utils.rs:206

↓ 4 callersMethodwrite

(&self, path: &str, args: OpWrite)

src/moonlink/src/storage/filesystem/accessor/filesystem_accessor_chaos_wrapper.rs:64

↓ 3 callersFunctionactive_pid_for_slot

(slot: &str)

src/moonlink_backend/tests/test_postgres_source.rs:25

↓ 3 callersMethodadd_manifest_entries

( &mut self, manifest_entries: Vec<Arc<ManifestEntry>>, manifest_metadata: ManifestMet

src/moonlink/src/storage/table/iceberg/data_file_manifest_manager.rs:54

↓ 3 callersMethodadd_table_schema

(self: Pin<&mut Self>, schema: TableSchema)

src/moonlink_connectors/src/pg_replicate/postgres_source.rs:590

↓ 3 callersMethodalter_table

( &mut self, alter_table_request: AlterTableRequest, )

src/moonlink/src/storage/mooncake_table.rs:616

↓ 3 callersFunctionany_slots

(rv: &RowValue)

src/moonlink_service/src/otel/otel_to_moonlink_pb.rs:485

↓ 3 callersFunctionappend_commit_flush_create_mooncake_snapshot_for_test

( table: &mut MooncakeTable, completion_rx: &mut Receiver<TableEvent>, rows: Vec<MoonlinkRow>,

src/moonlink/src/storage/mooncake_table/test_utils.rs:182

↓ 3 callersMethodapply_to_batch

Apply the deletion vector to filter a record batch

src/moonlink/src/storage/mooncake_table/delete_vector.rs:84

↓ 3 callersFunctionassert_scan_ids_eq

( backend: &MoonlinkBackend, database: String, table: String, lsn: u64, expected: impl Int

src/moonlink_backend/tests/common.rs:247

↓ 3 callersMethodbegin_with_snapshot

Begin a read-only transaction importing a snapshot.

src/moonlink_connectors/src/pg_replicate/postgres_source.rs:264

↓ 3 callersMethodborrow

(&self)

src/moonlink/src/storage/compaction/table_compaction.rs:32

↓ 3 callersMethodbuffer_byte

Appends a byte to the active buffer or spills to the inactive buffer if full. Returns `true` if the active buffer was full and the byte was written to

src/moonlink/src/storage/async_bitwriter.rs:84

↓ 3 callersMethodbuild

(mut self, metadata: &GlobalIndex)

src/moonlink/src/storage/index/persisted_bucket_hash_map.rs:388

↓ 3 callersMethodbulk_upload_files

( &self, files: Vec<String>, storage_config: StorageConfig, lsn: u64, )

src/moonlink/src/table_handler/test_utils.rs:349

↓ 3 callersMethodcan_start_new_maintenance

We can have at most one table maintenance ongoing, only allow to start a new one when there's no ongoing operations, nor another requested ones.

src/moonlink/src/table_handler/table_handler_state.rs:515

↓ 3 callersFunctioncheck_persisted_metadata

(sqlite_metadata_store: &SqliteMetadataStore)

src/moonlink_metadata_store/src/sqlite/tests.rs:94

↓ 3 callersMethodcheck_wal_metadata_invariants

( &self, metadata: &PersistentWalMetadata, persistence_snapshot_lsn: Option<u64>,

src/moonlink/src/table_handler/test_utils.rs:489

↓ 3 callersMethodcollect_active_rows

(&self, total_rows: usize)

src/moonlink/src/storage/mooncake_table/delete_vector.rs:115

↓ 3 callersMethodcommit_transaction

(&mut self)

src/moonlink_connectors/src/pg_replicate/postgres_source.rs:236

↓ 3 callersFunctionconvert_mantissa_to_row_value

(mantissa: BigInt)

src/moonlink_connectors/src/rest_ingest/decimal_utils.rs:60

↓ 3 callersMethodcopy_out_with_predicate

Perform COPY using a SELECT with an additional WHERE predicate. Assumes caller opened a transaction.

src/moonlink_connectors/src/pg_replicate/clients/postgres.rs:247

↓ 3 callersFunctioncrash_and_recover_backend_with_guard

( mut guard: TestGuard, )

src/moonlink_backend/tests/common.rs:300

↓ 3 callersMethodcreate_global_index

Util function to build global index.

src/moonlink/src/storage/index/persisted_bucket_hash_map.rs:445

↓ 3 callersFunctioncreate_glue_catalog

Test util function to create a glue catalog.

src/moonlink/src/storage/table/iceberg/glue_catalog_test_utils.rs:57

↓ 3 callersFunctioncreate_local_file

Test util function to create local file with random content of given [`file_size`] to the destunation file (indicated by absolute path).

src/moonlink/src/storage/filesystem/accessor/test_utils.rs:22

↓ 3 callersFunctioncreate_local_parquet_file

Create a parquet file in the given temporary directory, and return parquet filepath.

src/moonlink/src/storage/mooncake_table/table_operation_test_utils.rs:46

↓ 3 callersFunctioncreate_manifest_writer_builder

Util function to create manifest write.

src/moonlink/src/storage/table/iceberg/manifest_utils.rs:40

↓ 3 callersFunctioncreate_mooncake_otel_table

Util function to create a mooncake table with otel schema.

src/moonlink_service/src/otel/otel_schema.rs:300

↓ 3 callersFunctioncreate_mooncake_table_and_notify_for_read

Test util function to create mooncake table and table notify for read test.

src/moonlink/src/storage/mooncake_table/table_creation_test_utils.rs:543

↓ 3 callersFunctioncreate_puffin_writer

Get puffin writer with the given file io.

src/moonlink/src/storage/table/iceberg/puffin_utils.rs:29

↓ 3 callersFunctioncreate_row

Create a test moonlink row.

src/moonlink/src/table_handler/chaos_test.rs:80

↓ 3 callersFunctioncreate_row

Creates a `MoonlinkRow` for testing purposes.

src/moonlink/src/table_handler/test_utils.rs:40

↓ 3 callersFunctioncreate_test_filesystem_accessor

( iceberg_table_config: &IcebergTableConfig, )

src/moonlink/src/table_handler/profile_test.rs:454

↓ 3 callersFunctioncreate_test_json_payload

Test util function to create json payload.

src/moonlink_service/src/test_utils.rs:110

↓ 3 callersFunctioncreate_test_pool

()

src/moonlink_datafusion/src/connection_pool.rs:146

↓ 3 callersFunctioncreate_test_wal

Helper function to create a WAL with some test data

src/moonlink/src/storage/wal/test_utils.rs:298

↓ 3 callersMethodcreate_unbuffered_stream_writer

( &self, object_filepath: &str, )

src/moonlink/src/storage/filesystem/accessor/filesystem_accessor.rs:332

↓ 3 callersFunctiondecode_serialized_read_state_for_testing

( data: Vec<u8>, )

src/moonlink/src/union_read/read_state.rs:146

↓ 3 callersMethoddelete_table_metadata

(&self, database: &str, table: &str)

src/moonlink_metadata_store/src/postgres/pg_metadata_store.rs:121

↓ 3 callersFunctiondeserialize_moonlink_table_config

Deserialize json value to moonlink table config.

src/moonlink_metadata_store/src/config_utils.rs:154

↓ 3 callersFunctiondeserialize_parquet_metadata

(bytes: &[u8])

src/moonlink_backend/src/parquet_utils.rs:63

↓ 3 callersMethodequals_parquet_at_offset

( &self, file_name: &str, offset: usize, identity: &IdentityProp, )

src/moonlink/src/row/moonlink_row.rs:214

↓ 3 callersMethodestimate_relation_block_count

Estimate relation block count for CTID sharding

src/moonlink_connectors/src/pg_replicate/postgres_source.rs:164

↓ 3 callersMethodfinalize

(self: Box<Self>)

src/moonlink/src/storage/filesystem/accessor/unbuffered_stream_writer.rs:51

↓ 3 callersMethodforce_empty_persistence_payload

Mark next iceberg snapshot as force, even if the payload is empty.

src/moonlink/src/storage/mooncake_table.rs:1107

↓ 3 callersMethodforce_full_maintenance_and_sync

Force a full table maintenance task operation, and block wait its completion.

src/moonlink/src/table_handler/test_utils.rs:309

↓ 3 callersMethodget_accessor_config

(&self)

src/moonlink/src/storage/wal.rs:59

← previous next →401–500 of 2,717, ranked by callers