Method _shape

Vary-master/vary/model/llm/opt/modeling_opt.py:167–172

(self, tensor: torch.Tensor, seq_len: int, bsz: int)

        self.out_proj = nn.Linear(embed_dim, embed_dim, bias=bias)

    def _shape(self, tensor: torch.Tensor, seq_len: int, bsz: int):
        return (
            tensor.view(bsz, seq_len, self.num_heads, self.head_dim)
            .transpose(1, 2)
            .contiguous()
        )

    def forward(
        self,