Functions — github.com/Mooncake-Labs/moonlink

hub / github.com/Mooncake-Labs/moonlink / functions

Functions2,717 in github.com/Mooncake-Labs/moonlink

⨍ Functions 2,717◇ Types & classes 409

↓ 10 callersFunctioncheck_data_file_compaction

Test util function to validate data file compaction. # Arguments old_row_indices: row indices of the data files before compaction, which should exis

src/moonlink/src/storage/compaction/test_utils.rs:415

↓ 10 callersFunctioncheck_file_indices_compaction

Test util function to check file indices compaction. # Arguments old_row_indices: row indices of the data files before compaction, which should exis

src/moonlink/src/storage/compaction/test_utils.rs:489

↓ 10 callersMethodcreate_snapshot

Create an iceberg snapshot with the given LSN, return when the a snapshot is successfully created. If the requested database or table doesn't exist, r

src/moonlink_backend/src/lib.rs:145

↓ 10 callersMethoddrop_namespace

Drop a namespace from the catalog.

src/moonlink/src/storage/table/iceberg/file_catalog.rs:407

↓ 10 callersMethodflush_stream

# Arguments lsn: commit LSN for the current streaming transaction if assigned.

src/moonlink/src/storage/mooncake_table/transaction_stream.rs:522

↓ 10 callersFunctionget_backend_error_status_code

Map backend error to appropriate HTTP status code based on error type

src/moonlink_service/src/rest_api.rs:376

↓ 10 callersFunctionget_data_compaction_config

Test util function to get data compaction config for all unit tests under the test suite.

src/moonlink/src/storage/table/iceberg/compaction_tests.rs:91

↓ 10 callersFunctionget_deletion_logs_for_snapshot

Test util function to get committed and uncommitted deletion logs states.

src/moonlink/src/storage/mooncake_table/table_accessor_test_utils.rs:198

↓ 10 callersFunctionget_index_block_file_ids

Test util function to get index block file ids for the given mooncake table.

src/moonlink/src/storage/mooncake_table/table_accessor_test_utils.rs:238

↓ 10 callersFunctionget_index_block_filepaths

Test util function to get all index block filepaths from the given mooncake table, returned in alphabetic order.

src/moonlink/src/storage/mooncake_table/table_accessor_test_utils.rs:212

↓ 10 callersFunctionget_test_row_5

()

src/moonlink/src/storage/table/iceberg/state_tests.rs:88

↓ 10 callersFunctionprepare_committed_and_flushed_data_files

Test util function which imports two data files and file indices to mooncake table and iceberg table. These two data files are committed and flushed a

src/moonlink/src/storage/table/iceberg/compaction_tests.rs:249

↓ 10 callersMethodrun_control_query

Centralized control-plane query executor. Retries with backoff on connection errors.

src/moonlink_connectors/src/pg_replicate.rs:185

↓ 10 callersMethodsubscribe

Subscribe for async notifications when the replicated LSN advances.

src/moonlink/src/lsn_state.rs:46

↓ 9 callersMethodabort

(&mut self)

src/moonlink/src/storage/filesystem/accessor/filesystem_accessor_chaos_wrapper.rs:136

↓ 9 callersMethodadd_table

( &mut self, src_table_id: SrcTableId, event_sender: Sender<TableEvent>, commi

src/moonlink_connectors/src/pg_replicate/moonlink_sink.rs:97

↓ 9 callersMethodadd_table

# Arguments persist_lsn: only assigned at recovery, used to indicate and update replication LSN.

src/moonlink_connectors/src/rest_ingest/rest_source.rs:79

↓ 9 callersFunctionas_array

(rv: &RowValue)

src/moonlink_service/src/otel/otel_to_moonlink_pb.rs:470

↓ 9 callersFunctionas_struct

(rv: &RowValue)

src/moonlink_service/src/otel/otel_to_moonlink_pb.rs:476

↓ 9 callersFunctioncheck_loaded_snapshot

Test util function to check compacted data file is as expected. Return file id for the compacted data file.

src/moonlink/src/storage/table/iceberg/compaction_tests.rs:229

↓ 9 callersFunctioncheck_row_index_on_disk

Test util function to check the given row exists in snapshot, and it's on-disk.

src/moonlink/src/storage/mooncake_table/validation_test_utils.rs:166

↓ 9 callersFunctioncheck_snapshot_reflects_persistence_for_compaction

Test util function to check whether mooncake snapshot does match persisted snapshot for data files and file indices after compaction. # Arguments ta

src/moonlink/src/storage/table/iceberg/compaction_tests.rs:282

↓ 9 callersMethodcmp

(&self, other: &Self)

src/moonlink/src/storage/index/persisted_bucket_hash_map.rs:813

↓ 9 callersFunctioncreate_file_index_1

Test util function to create and dump file index, which correspond to test record batch.

src/moonlink/src/storage/compaction/test_utils.rs:95

↓ 9 callersFunctioncreate_object_storage_cache_with_local_optimization

This module check state machine when local filesystem optimization enabled. The state transfer is the same as usual, but different at eviction / delet

src/moonlink/src/storage/cache/object_storage/local_file_optimization_state_tests.rs:34

↓ 9 callersMethodcreate_table

Create a new table inside the namespace.

src/moonlink/src/storage/table/iceberg/file_catalog.rs:470

↓ 9 callersFunctioncreate_test_batch_2

()

src/moonlink/src/storage/compaction/test_utils.rs:64

↓ 9 callersMethodget_all_table_metadata_entries

(&self)

src/moonlink_metadata_store/src/postgres/pg_metadata_store.rs:29

↓ 9 callersMethodget_cache_filepath

Get cache file path.

src/moonlink/src/storage/cache/object_storage/cache_handle.rs:43

↓ 9 callersFunctionget_data_files_and_index_block_files

Test util to get data files and index block filepaths for the given mooncake table, filepaths returned in alphabetical order.

src/moonlink/src/storage/mooncake_table/table_accessor_test_utils.rs:137

↓ 9 callersFunctionget_file_indices_for_table

Test util function to get file indices for the given mooncake table.

src/moonlink/src/storage/mooncake_table/table_accessor_test_utils.rs:22

↓ 9 callersMethodget_file_system_accessor

(&self)

src/moonlink/src/storage/wal.rs:486

↓ 9 callersFunctionget_flush_results

=============================== Flush =============================== Synchronize on ongoing flushes and return a map of <event id, disk slice>.

src/moonlink/src/storage/mooncake_table/table_operation_test_utils.rs:70

↓ 9 callersFunctionget_record_location_mapping

Test util function to get old record location to new one mapping.

src/moonlink/src/storage/compaction/test_utils.rs:249

↓ 9 callersFunctionmake_table_schema

(src_table_id: SrcTableId)

src/moonlink_connectors/src/pg_replicate/moonlink_sink.rs:417

↓ 9 callersFunctionmake_test_schema

()

src/moonlink_connectors/src/rest_ingest/rest_source.rs:466

↓ 9 callersMethodoutput_files

Get the list of files in the DiskSlice

src/moonlink/src/storage/mooncake_table/disk_slice.rs:144

↓ 9 callersMethodpersist_iceberg_snapshot

Create an iceberg snapshot.

src/moonlink/src/storage/mooncake_table.rs:1668

↓ 9 callersFunctionvalidate_only_initial_snapshot

Validate only old snapshot, but not newly created ones.

src/moonlink/src/storage/table/iceberg/state_tests.rs:312

↓ 8 callersMethodadd_table

(&mut self, name: impl Into<String>)

src/moonlink_connectors/src/pg_replicate/tests/test_utils.rs:188

↓ 8 callersFunctionbatch_with_rows

(ids: &[i32])

src/moonlink/src/storage/mooncake_table/batch_ingestion.rs:228

↓ 8 callersFunctionbuild_arrow_schema_impl

(fields: &[FieldSchema])

src/moonlink_connectors/src/rest_ingest/schema_util.rs:184

↓ 8 callersFunctionconvert_to_wal_events_vector

(table_events: &[TableEvent])

src/moonlink/src/storage/wal/test_utils.rs:165

↓ 8 callersMethodcopy_from_local_to_remote

(&self, src: &str, dst: &str)

src/moonlink/src/storage/filesystem/accessor/filesystem_accessor.rs:351

↓ 8 callersFunctiondecode_read_state_for_testing

( read_state: &ReadState, )

src/moonlink/src/union_read/read_state.rs:126

↓ 8 callersFunctiondrop_read_states_and_create_mooncake_snapshot

Test util function to drop read states and create a mooncake snapshot to reflect. Return evicted files to delete.

src/moonlink/src/storage/mooncake_table/table_operation_test_utils.rs:677

↓ 8 callersMethodfast_delete

(&mut self, raw_record: &RawDeletionRecord)

src/moonlink/src/storage/index/mem_index.rs:67

↓ 8 callersMethodflush

Drains the current mem slice and create a disk slice. Flushes the disk slice. Adds the disk slice to `next_snapshot_task`.

src/moonlink/src/storage/mooncake_table.rs:1317

↓ 8 callersMethodget_table_schema

( &self, src_table_id: SrcTableId, table_name: TableName, publication: Option<

src/moonlink_connectors/src/pg_replicate/clients/postgres.rs:670

↓ 8 callersFunctionimport_fake_cache_entry

Test util function to import a second object storage cache entry.

src/moonlink/src/storage/mooncake_table/cache_test_utils.rs:9

↓ 8 callersMethodis_empty

Return whether data compaction result is empty.

src/moonlink/src/storage/compaction/table_compaction.rs:178

↓ 8 callersMethodload_table

Load table from the catalog.

src/moonlink/src/storage/table/iceberg/file_catalog.rs:529

↓ 8 callersFunctionperform_data_compaction_for_test

=============================== Data compaction =============================== Perform data compaction for the given table, and reflect the result t

src/moonlink/src/storage/mooncake_table/table_operation_test_utils.rs:293

↓ 8 callersMethodschema

(&mut self, _schema: &Schema, _value: Self::T)

src/moonlink/src/storage/table/iceberg/parquet_utils.rs:122

↓ 8 callersFunctionsetup_connection

()

src/moonlink_connectors/src/pg_replicate/tests/test_utils.rs:21

↓ 8 callersMethodunpin_referenced_compaction_payload

Unpin all referenced files after compaction, so they could be evicted and deleted. Return evicted files to delete.

src/moonlink/src/storage/compaction/table_compaction.rs:119

↓ 8 callersMethodunreference_and_replace_with_remote

( &self, remote_filepath: &str, )

src/moonlink/src/storage/cache/object_storage/cache_handle.rs:79

↓ 8 callersFunctionvalidate_only_new_deletion_vectors_in_snapshot

Validate new snapshot with new deletion vector created, but no data files.

src/moonlink/src/storage/table/iceberg/state_tests.rs:362

↓ 8 callersMethodwrite_from_shared

Consume RecordBatches from a shared receiver and write Parquet files. Returns the list of file paths written by this worker.

src/moonlink_connectors/src/pg_replicate/initial_copy_writer.rs:155

↓ 8 callersFunctionwrite_parquet_file

(path: &std::path::Path, batches: &[RecordBatch])

src/moonlink/src/storage/mooncake_table/batch_ingestion.rs:218

↓ 8 callersFunctionwrite_usize

(writer: &mut W, value: usize)

src/moonlink_table_metadata/src/table_metadata.rs:171

↓ 7 callersFunctionalter_table_and_persist_to_iceberg

( table: &mut MooncakeTable, notify_rx: &mut Receiver<TableEvent>, )

src/moonlink/src/storage/mooncake_table/table_operation_test_utils.rs:704

↓ 7 callersFunctionassert_scan_nonunique_ids_eq

( backend: &MoonlinkBackend, database: String, table: String, lsn: u64, expected_counts: &

src/moonlink_backend/tests/common.rs:264

↓ 7 callersMethodbuild

(self)

src/moonlink/src/storage/cache/metadata/test_utils.rs:23

↓ 7 callersFunctionbuild_tls_connector

()

src/moonlink_connectors/src/pg_replicate/clients/postgres.rs:939

↓ 7 callersFunctioncheck_file_pinned

Test util function to check certain data file exists in non evictable cache.

src/moonlink/src/storage/mooncake_table/validation_test_utils.rs:136

↓ 7 callersMethodclose

Close the current bit writer, several steps involved: - Pads the current bit queue with zeros until aligned to the next byte boundary. - Flush both ac

src/moonlink/src/storage/async_bitwriter.rs:194

↓ 7 callersMethodconditional_write_object

( &self, object: &str, content: Vec<u8>, etag: Option<String>, )

src/moonlink/src/storage/filesystem/accessor/filesystem_accessor.rs:304

↓ 7 callersFunctioncopy_table_stream

Reads rows using parallel readers and sends them to the provided `event_sender`.

src/moonlink_connectors/src/pg_replicate/initial_copy.rs:57

↓ 7 callersFunctioncreate_replication_client

()

src/moonlink_connectors/src/pg_replicate/tests/test_utils.rs:33

↓ 7 callersFunctiondrop_table

Util function to drop table via REST API.

src/moonlink_service/src/test_utils.rs:666

↓ 7 callersFunctionexport_metrics_to_moonlink_rows

( req: &ExportMetricsServiceRequest, )

src/moonlink_service/src/otel/otel_to_moonlink_pb.rs:13

↓ 7 callersMethodexport_snapshot_and_lsn

Export a snapshot and capture current WAL LSN. Keeps the txn open.

src/moonlink_connectors/src/pg_replicate/postgres_source.rs:254

↓ 7 callersFunctiongenerate_parquet_file

Test util function to generate a parquet under the given [`tempdir`].

src/moonlink/src/table_handler/test_utils.rs:641

↓ 7 callersFunctionget_io_error_status

(source: &std::io::Error)

src/moonlink_error/src/io_error_utils.rs:3

↓ 7 callersFunctionget_sqlite_database_filepath

Test util function to get sqlite database filepath.

src/moonlink_metadata_store/src/sqlite/tests.rs:111

↓ 7 callersFunctionget_table_uri

Util function to get database URI.

src/moonlink_metadata_store/tests/test_pg_metadata_store.rs:29

↓ 7 callersFunctionkvs_to_rowvalue_array_anyvalue

attributes => List<Struct{ key: Utf8, value: AnyValueStruct }>

src/moonlink_service/src/otel/otel_to_moonlink_pb.rs:147

↓ 7 callersFunctionmake_schema

()

src/moonlink_connectors/src/rest_ingest/json_converter.rs:242

↓ 7 callersMethodobject_exists

=============================== Object operations ===============================

src/moonlink/src/storage/filesystem/accessor/filesystem_accessor.rs:227

↓ 7 callersFunctionread_u32

(reader: &mut R)

src/moonlink_table_metadata/src/table_metadata.rs:176

↓ 7 callersMethodset_test_mode

(&mut self, mode: TestGuardMode)

src/moonlink_backend/tests/common.rs:105

↓ 7 callersMethodstart

(&'a self)

src/moonlink/src/observability/snapshot_creation.rs:28

↓ 7 callersMethodstore_table_metadata

( &self, database: &str, table: &str, src_table_name: &str, src_table_

src/moonlink_metadata_store/src/postgres/pg_metadata_store.rs:70

↓ 7 callersMethodstore_table_metadata

( &self, database: &str, table: &str, src_table_name: &str, src_table_

src/moonlink_metadata_store/src/sqlite/sqlite_metadata_store.rs:70

↓ 7 callersFunctiontest_row_2

()

src/moonlink/src/storage/table/iceberg/tests.rs:141

↓ 7 callersMethodtry_delete_cache_entry

(&self, file_id: TableUniqueFileId)

src/moonlink/src/storage/cache/object_storage/object_storage_cache.rs:506

↓ 7 callersFunctionvalidate_no_snapshot

============================== State validation functions ============================== Validate cases where no new iceberg snapshot created.

src/moonlink/src/storage/table/iceberg/state_tests.rs:287

↓ 7 callersMethodwait_for_wal_flush

Wait for the WAL flush LSN to reach the requested LSN. Note that WAL flush LSN will update up till the latest commit that has been persisted in to the

src/moonlink_backend/src/lib.rs:407

↓ 7 callersFunctionwrite_arrow_record_batch_to_local

Test util function to write arrow record batch into local file.

src/moonlink/src/storage/table/iceberg/tests.rs:183

↓ 7 callersFunctionwrite_u32

(writer: &mut W, value: u32)

src/moonlink_table_metadata/src/table_metadata.rs:167

↓ 6 callersMethodbyte_align

(&mut self)

src/moonlink/src/storage/async_bitwriter.rs:179

↓ 6 callersMethodcan_drop_table_now

Return whether table handler could be dropped now. If there're any background activities ongoing, we cannot drop table immediately.

src/moonlink/src/table_handler/table_handler_state.rs:350

↓ 6 callersFunctioncheck_file_not_pinned

Test util function to check certain data file doesn't exist in non evictable cache.

src/moonlink/src/storage/mooncake_table/validation_test_utils.rs:126

↓ 6 callersFunctioncheck_read_snapshot

Verifies the state of a read snapshot against expected row IDs.

src/moonlink/src/table_handler/test_utils.rs:598

↓ 6 callersMethodcheck_wal_events_from_metadata

( &self, wal_metadata: &PersistentWalMetadata, should_contain_table_events: &[TableEve

src/moonlink/src/table_handler/test_utils.rs:469

↓ 6 callersFunctioncommit_transaction_stream_and_sync

Commit transaction stream, block wait its completion and reflect result to mooncake table.

src/moonlink/src/storage/mooncake_table/table_operation_test_utils.rs:201

↓ 6 callersMethodcommit_txn

Commits a transaction

src/moonlink_connectors/src/pg_replicate/clients/postgres.rs:124

↓ 6 callersFunctioncreate_file_io

Create iceberg [`FileIO`].

src/moonlink/src/storage/table/iceberg/io_utils.rs:101

↓ 6 callersFunctioncreate_remote_file

Test util function to create a remote file with random content of given [`file_size`], and write it to the destination file (indicated by absolute pat

src/moonlink/src/storage/filesystem/accessor/test_utils.rs:38

← previous next →201–300 of 2,717, ranked by callers