Index into embeddings. # TODO: add different types of initializations Args: in_dim: Number of embeddings out_dim: Dimension o

Module for integrated directional encoding (IDE). from Equations 6-8 of arxiv.org/abs/2112.03907.

Chains list of learning rate schedulers. It takes a list of chainable learning rate schedulers and performs consecutive step() functions belong to

Receives the list of schedulers that is expected to be called sequentially during optimization process and milestone points that provides exact in

Two ways to print to console: 1. self.print: correctly handle progress bar 2. rank_zero_info: use the logging module

Decays the learning rate of each parameter group by a small constant factor until the number of epoch reaches a pre-defined milestone: total_iters

Field modules that can be combined to store and compute the fields. Args: in_dim: Input dimension to module. out_dim: Ouput dimen

Decays the learning rate of each parameter group by linearly changing small multiplicative factor until the number of epoch reaches a pre-defined

Two ways to print to console: 1. self.print: correctly handle progress bar 2. rank_zero_info: use the logging module

Two ways to print to console: 1. self.print: correctly handle progress bar 2. rank_zero_info: use the logging module