MCPcopy Create free account
hub / github.com/VisionXLab/OF-Diff / _resize_pos_embed

Function _resize_pos_embed

ldm/modules/midas/midas/vit.py:100–114  ·  view source on GitHub ↗
(self, posemb, gs_h, gs_w)

Source from the content-addressed store, hash-verified

98
99
100def _resize_pos_embed(self, posemb, gs_h, gs_w):
101 posemb_tok, posemb_grid = (
102 posemb[:, : self.start_index],
103 posemb[0, self.start_index :],
104 )
105
106 gs_old = int(math.sqrt(len(posemb_grid)))
107
108 posemb_grid = posemb_grid.reshape(1, gs_old, gs_old, -1).permute(0, 3, 1, 2)
109 posemb_grid = F.interpolate(posemb_grid, size=(gs_h, gs_w), mode="bilinear")
110 posemb_grid = posemb_grid.permute(0, 2, 3, 1).reshape(1, gs_h * gs_w, -1)
111
112 posemb = torch.cat([posemb_tok, posemb_grid], dim=1)
113
114 return posemb
115
116
117def forward_flex(self, x):

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected