A transformer decoder that attends to an input image using queries whose positional embedding is supplied. Args: d

A transformer block with four layers: (1) self-attention of sparse inputs, (2) cross attention of sparse inputs to dense inputs, (3)

Args: image_embedding (torch.Tensor): image to attend to. Should be shape B x embedding_dim x h x w for any h and w.

Generate positional encoding for a grid of the specified size.

Positionally encode points that are not normalized to [0,1].