Computes the stability score for a batch of masks. The stability score is the IoU between the binary masks obtained by thresholding the p

Add new points and labels to previous point inputs (add at the end).

Positionally encode points that are not normalized to [0,1].

return given network

Load the video frames from a directory of JPEG files ("<frame_index>.jpg" format). The frames are resized to image_size x image_size and are

Encodes masks to an uncompressed RLE, in the format expected by pycoco tools.

Removes small disconnected regions and holes in a mask. Returns the mask and an indicator of if the mask has been modified.

Remove all input points or mask in all frames throughout the video.

Compute a binary mask from an uncompressed RLE.

Add new mask to a frame.

Initialize the neck :param trunk: the backbone :param position_encoding: the positional encoding to use :param d_model: the di

Build SAM-style prompt encoder and mask decoder.

When outputting a single mask, if the stability score from the current single-mask output (based on output token 0) falls below a thr

Embeds box prompts.

Embeds mask inputs.

Embeds point prompts.

Gets the batch size of the output given the batch size of the input prompts.

Get a dummy object pointer based on an empty mask on the current frame.

Compute stability scores of the mask logits based on the IoU between upper and lower thresholds, similar to https://github.com/fairin

Fuse the current frame's visual feature map with previous memory.

Reset all tracking inputs and results across the videos.

Run the memory encoder on `high_res_masks`. This is usually after applying non-overlapping constraints to object scores. Since their

Directly turn binary `mask_inputs` into a output mask logits without using SAM. (same input and output shapes as in _forward_sam_head

Whether to use multimask output in the SAM head.

Add new points to a frame.

Generates point grids for all crop layers.

Generates a 2D grid of points evenly spaced in [0,1]x[0,1].

threshold: a int or a tuple of int masks: [b,2,h,w] pred: [b,2,h,w]

threshold: a int or a tuple of int masks: [b,2,h,w] pred: [b,2,h,w]

A post processor to fill small holes in mask scores with area under `max_area`.

Generates a list of crop boxes of different sizes. Each layer has (2**i)**2 boxes for the ith layer.

Get 1D sine positional embedding as in the original Transformer paper.

Return an activation function given a string

Filter masks at the edge of a crop, but not at the edge of the original image.

Load the video frames from a directory of JPEG files ("<frame_index>.jpg" format). The frames are resized to image_size x image_size and are

Perform PostProcessing on output masks.