MCPcopy Index your code
hub / github.com/Turing-Project/WriteGPT / create_initializer

Function create_initializer

LanguageNetwork/GPT2/scripts/modeling.py:119–121  ·  view source on GitHub ↗

Creates a `truncated_normal_initializer` with the given range.

(initializer_range=0.02)

Source from the content-addressed store, hash-verified

117
118
119def create_initializer(initializer_range=0.02):
120 """Creates a `truncated_normal_initializer` with the given range."""
121 return tf.truncated_normal_initializer(stddev=initializer_range)
122
123
124def _attention_projection_and_transpose(x_flat, batch_size, seq_length, num_attention_heads, size_per_head,

Callers 4

attention_layerFunction · 0.70
residual_mlp_layerFunction · 0.70
embedFunction · 0.70

Calls

no outgoing calls

Tested by

no test coverage detected