MCPcopy Create free account
hub / github.com/pytorch/examples / ModelArgs

Class ModelArgs

distributed/FSDP2/model.py:9–15  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

7
8@dataclass
9class ModelArgs:
10 n_layers: int = 2
11 vocab_size: int = 8
12 max_seq_len: int = 16
13 dim: int = 16
14 n_heads: int = 4
15 dropout_p: float = 0.1
16
17
18class Attention(nn.Module):

Callers 1

mainFunction · 0.90

Calls

no outgoing calls

Tested by

no test coverage detected