Lifecycle

CRUD

setupTestCollection creates a REAL SQLite-backed collection for integration testing.

setupTestRepo creates a REAL CollectionRepo for integration testing.

Search The store implementation handles translating generic queries into SQL/FTS/Vector logic.

NewPathConfig creates a new PathConfig with the specified data directory.

NewCollection initializes a Collection.

Serve handles service method invocations from other collectors

shutdown stops the test server

NewLocalFileSystem creates a new LocalFileSystem rooted at the given path.

RegisterService registers a service handler for a namespace and method

setupTestServer creates a test gRPC server with a dispatcher

CollectionDBPath returns the path for a collection's database file. Format: {DataDir}/{namespace}/{name}.db

setupGrpcServer creates a test gRPC server with PathConfig

setupTestService creates a test service instance

BootstrapSystemCollections initializes all system collections in the correct order This creates a self-referential bootstrap sequence where: 1. Collec

CollectionFilesPath returns the path for a collection's file storage. Format: {DataDir}/files/{namespace}/{name}

ListConnections returns Connection protos for all active connections. If persistence is enabled, this loads the persisted data. Otherwise, it uses the

NewBackupManager creates a new backup manager.

ValidateNamespace validates a namespace name and checks if it's reserved.

Close closes the backup manager.

dialContext creates a client connection to the test server

CheckOperationConflict checks if an operation can start. Returns ErrOperationInProgress if a non-timed-out operation exists.

NewConnectionManager creates a new connection manager. The sessionID should be unique per collector restart (e.g., UUID or timestamp-based).

GetConnectionManager returns the connection manager

Log records an audit event.

ValidateCollectionName validates a collection name.

createTestStore creates a simple SQLite store for testing

sanitizePath validates and cleans a user-provided path to prevent directory traversal attacks. Returns error if the path attempts to escape the root d

Connect handles incoming connection requests

FindSimilar performs a semantic search by embedding the query text and running a vector search against the Store.

GetFile retrieves a file. It automatically handles the logic of returning raw bytes for small files or a URI for large files (optional optimization).

--- Filesystem Logic --- SaveFile writes a CollectionData proto to the underlying FileSystem.

ValidateMethod checks if a method exists on a registered service

BackupCollection creates a backup of a collection.

BackupDir returns the base backup directory. Format: {DataDir}/.backup

CompleteOperation clears the operation state after completion. If the collection no longer exists (e.g., it was deleted), this is a no-op and returns

GetOperationState reads the operation state from collection metadata. Returns nil if no operation is in progress.

HandleConnect processes an incoming connection request from another collector.

LookupService retrieves a registered service by namespace and service name

NewBackupMetadataStore creates a new backup metadata store.

NewStaticJSONConverter creates a converter for a known proto.Message type. Use this for system collections where the type is known at compile time.

SaveBackup saves backup metadata.

SetJSONConverter sets the function used to convert binary proto_data to JSON for the jsontext column. This must be called before CreateRecord/UpdateRe

StartOperation begins a new operation by setting the operation state. Returns error if an operation is already in progress.

setupTestCollection creates a test collection for connections

Backup creates an online backup of the database to the specified path. This method is WAL-friendly and allows concurrent reads/writes during backup. I

Close closes the metadata store.

GetSystemTypeConverter returns a converter for a known system type by name. Returns nil if the type is not a known system type.

BackupsMetadataPath returns the path for backup metadata database. Format: {DataDir}/backups/metadata.db

ConnectTo initiates a connection to another collector

Dispatch routes a request to the appropriate collector

ListServices returns all registered services, optionally filtered by namespace

NewCollectionRegistryStoreFromStore creates a CollectionRegistryStore using the provided Store. This is useful for testing where you want to use an in

NewCollectionRepo creates a new DefaultCollectionRepo with the given Store, PathConfig, RegistryStore, and StoreFactory.

NewCollectionWithOptions initializes a Collection with functional options.

GetMessageType retrieves a registered message type's validation rule

NewDispatcher creates a new dispatcher instance

NewServerWithValidation creates a new gRPC server with registry validation enabled