Args: image_embedding (torch.Tensor): image to attend to. Should be shape B x embedding_dim x h x w for any h and w.

Predicts masks end-to-end from provided images and prompts. If prompts are not known in advance, using SamPredictor is recomm

Embeds different types of prompts, returning both sparse and dense embeddings. Arguments: points (tuple(torch.Tens

Generate positional encoding for a grid of the specified size.

Positionally encode points that are not normalized to [0,1].

Generates a list of crop boxes of different sizes. Each layer has (2**i)**2 boxes for the ith layer.

Returns the positional encoding used to encode point prompts, applied to a dense set of points the shape of the image encoding.

Returns the image embeddings for the currently set image, with shape 1xCxHxW, where C is the embedding dimension and (H,W) are

Filter masks at the edge of a crop, but not at the edge of the original image.

Compute the losses related to the bounding boxes, the L1 regression loss and the GIoU loss targets dicts must contain the key "boxes" conta

Compute the cardinality error, ie the absolute error in the number of predicted non-empty boxes This is not really a loss, it is intended for

Classification loss (NLL) targets dicts must contain the key "labels" containing a tensor of dim [nb_target_boxes]

Encodes masks to an uncompressed RLE, in the format expected by pycoco tools.

Compute the bounding boxes around the provided masks The masks should be in format [N, H, W] where N is the number of masks, (H, W) are the spati

Predict masks for the given input prompts, using the currently set image. Arguments: point_coords (np.ndarray or None): A

Args: input_dict (dict): all the values will be reduced average (bool): whether to do average or sum Reduce the values in the

Removes small disconnected regions and holes in a mask. Returns the mask and an indicator of if the mask has been modified.

Compute a binary mask from an uncompressed RLE.

Calculates the image embeddings for the provided image, allowing masks to be predicted with the 'predict' method. Arguments:

Warning: does not synchronize the deque!