MCPcopy Create free account
hub / github.com/NVIDIA/FasterTransformer / create_initializer

Function create_initializer

examples/tensorflow/bert/utils/common.py:72–73  ·  view source on GitHub ↗
(initializer_range=0.02, data_type=tf.float32)

Source from the content-addressed store, hash-verified

70 self.memory_hidden_dim = memory_hidden_dim
71
72def create_initializer(initializer_range=0.02, data_type=tf.float32):
73 return tf.truncated_normal_initializer(stddev=initializer_range, dtype=data_type)
74
75def time_test(sess, tensor, iterations=100, warmup=True):
76 # return in ms

Callers 2

attention_layerFunction · 0.90
tf_bertFunction · 0.90

Calls

no outgoing calls

Tested by

no test coverage detected