Layer normalizes :obj:`inputs`.
(inputs)
| 26 | return use_batch_major_op_cache, x |
| 27 | |
| 28 | def norm(inputs): |
| 29 | """Layer normalizes :obj:`inputs`.""" |
| 30 | return tf.contrib.layers.layer_norm(inputs, begin_norm_axis=-1) |
| 31 | |
| 32 | |
| 33 | def split_heads(inputs, num_heads): |