MCPcopy Create free account
hub / github.com/brightmart/bert_language_understanding / encoder_single_layer

Method encoder_single_layer

model/encoder.py:47–66  ·  view source on GitHub ↗

singel layer for encoder.each layers has two sub-layers: the first is multi-head self-attention mechanism; the second is position-wise fully connected feed-forward network. for each sublayer. use LayerNorm(x+Sublayer(x)). input and output of last dimension: d_model :

(self,Q,K_s,V_s,layer_index)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

encoder_fnMethod · 0.95

Tested by

no test coverage detected