MCPcopy Create free account
hub / github.com/tensorflow/lingvo / FPropWithPosition

Method FPropWithPosition

lingvo/core/layers.py:3277–3293  ·  view source on GitHub ↗

Generates a Tensor of sinusoids with different frequencies. Uses the provided position tensor to generate positional embeddings. Refer to FProp description for details of sinusoidal positional embeddings. Args: theta: A `.NestedMap` object containing weights' values of this layer

(self, theta, position_tensor)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 15

testAttenProbsMethod · 0.45
_AttenLogitsMethod · 0.45
_AttenLogitsOneStepMethod · 0.45
_AttenLogitsMethod · 0.45
_StreamAttenLogitsMethod · 0.45
_AttenLogitsOneStepMethod · 0.45
_AttenLogitsMethod · 0.45
_ComputeDecoderInputMethod · 0.45
_ComputeDecoderInputMethod · 0.45

Calls 1

Tested by 2

testAttenProbsMethod · 0.36