Cleanly shutdown the queue.

Error return the last error observed by the source.

Wait enters the barrier for the specified Step type and blocks until NotifyWorkers is invoked. The method returns back the Step message passed to Noti

Next fetches the next payload from the source. If no more items are available or an error occurs, calls to Next return false.

UpsertLink creates a new link or updates an existing link.

Close the iterator and release any allocated resources.

Process operates on the input payload and returns back a new payload to be forwarded to the next pipeline stage. Processors may also opt to prevent th

UpsertLink inserts or updates a link.

Aggregator returns the aggregator with the specified name or nil if the aggregator does not exist

Link returns the currently fetched link object.

Serve listens for incoming connections on a random open port until ctx expires. It returns back the address that the server is listening on.

ID returns the vertex ID.

Index inserts a new document to the index or updates the index entry for and existing document.

EXPECT returns an object that allows the caller to indicate expected use

Superstep returns the current superstep value.

Edge returns the currently fetched edge objects.

Value returns the value associated with this edge.

Notify passes a Step message broadcasted by the master to the worker waiting on the barrier specified by the Step type.

Run executes the service and blocks until the context gets cancelled or an error occurs.

UpsertEdge creates a new edge or updates an existing edge.

UpsertEdge inserts or updates an edge.

AddVertex inserts a new vertex with the specified id and initial value into the graph. If the vertex already exists, AddVertex will just overwrite its

Dial establishes a connection to the master node.

Graph returns the underlying bspgraph.Graph instance.

Index inserts a new document to the index or updates the index entry for and existing document.

New returns a new pipeline instance where input payloads will traverse each one of the specified stages.

NewGraph creates a new Graph instance using the specified configuration. It is important for callers to invoke Close() on the returned graph instance

Set the aggregator to the specified value.

Vertices returns the graph vertices as a map where the key is the vertex ID.

WaitForWorkers blocks until all workers enter the barrier for stepType (or the context associated with the barrier expires) and returns back the Step

FindByID looks up a document by its link ID.

Message returns the message currently pointed to by the iterator.

NewLinkGraphClient returns a new client instance that implements a subset of the graph.Graph interface by delegating methods to a graph instance expos

NewMockPrivateNetworkDetector creates a new mock instance

Search the index for a particular query and return back a result iterator.

SendMessage attempts to deliver a message to the vertex with the specified destination ID. Messages are queued for delivery and will be processed by r

Validate the config options.

AddEdge inserts a directed edge from src to destination and annotates it with the specified initValue. By design, edges are owned by the source vertic

Aggregate updates the aggregator's value based on the provided value.

Close shuts down the worker.

Dial a remote host.

Next advances the iterator so that the next message can be retrieved via a call to Message(). If no more messages are available or an error occurs, Ne

NotifyWorkers broadcasts the provided Step message to all workers waiting on the barrier for the specified message type.

Run implements the processing logic for this stage by reading incoming Payloads from an input channel, processing them and outputting the results to a

RunJob waits for a new job announcement from the master and coordinates its execution with the master until it either completes or is aborted due to a

RunToCompletion keeps executing supersteps until the context expires, an error occurs or one of the Pre/PostStepKeepRunning callbacks specified at con

StageIndex returns the position of this stage in the pipeline.

Close disconnects any connected workers and shuts down the gRPC server.

EXPECT returns an object that allows the caller to indicate expected use

EXPECT returns an object that allows the caller to indicate expected use

NewMaster creates a new Master instance with the specified configuration.

NewTextIndexerClient returns a new client instance that implements a subset of the index.Indexer interface by delegating methods to an indexer instanc

NewWorker creates a new Worker instance with the specified configuration.

RegisterAggregator adds an aggregator with the specified name into the graph.

Search the index for a particular query and stream the results back to the client. The first response will include the total result count while all su

SetValue sets the value associated with this edge.

Start listening on the configured address for incoming worker connections. Calls to Start are non-blocking. The caller must invoke the Close method to

UpdateScore updates the PageRank score for a document with the specified link ID. If no such document exists, a placeholder document with the provided

UpdateScore updates the PageRank score for a document with the specified link ID.

newMasterStepBarrier creates a new barrier instance for a master node that will be accessed by the specified number of remote workers.

Close releases any resources associated with the graph.

Edges returns an iterator for the set of edges whose source vertex IDs belong to the [fromID, toID) range and were updated before the provided timesta

Edges streams the set of edges in the specified ID range.

Executor creates and return a bspgraph.Executor for running the PageRank algorithm once the graph layout has been properly set up.

NewMockURLGetter creates a new mock instance

NewRange creates a new range [start, end) and splits it into the provided number of partitions.

RemoveStaleEdges removes any edge that originates from the specified link ID and was updated before the specified timestamp.

RunJob creates a new job and coordinates its execution until the job completes, the context expires or some error occurs. The minWorkers parameter def

newRemoteWorkerStream creates a stream abstraction for interacting with a remote worker instance.

AddVertex inserts a new vertex with the specified ID into the graph.

AddWorker adds a new worker to the pool.

BroadcastToNeighbors is a helper function that broadcasts a single message to each neighbor of a particular vertex. Messages are queued for delivery a

Context mocks base method

DetectFromSRVRecords returns a PartitionDetector implementation that extracts the current partition name from the current host name and attempts to de

Document returns the current document from the result set.

EXPECT returns an object that allows the caller to indicate expected use

EXPECT returns an object that allows the caller to indicate expected use

EXPECT returns an object that allows the caller to indicate expected use