Conv1d + GLU(Gated Linear Unit) with residual connection. For GLU refer to https://arxiv.org/abs/1612.08083 paper.

Synthesizer for Training

Dialted and Depth-Separable Convolution

Codebook with Euclidean distance. Args: dim (int): Dimension. codebook_size (int): Codebook size. kmeans_init (bool): Whet

MelStyleEncoder

Multi-Head Attention module

Residual vector quantization implementation. Follows Algorithm 1. in https://arxiv.org/pdf/2107.03312.pdf

Residual Vector Quantizer. Args: dimension (int): Dimension of the codebooks. n_q (int): Number of residual vector quantizers used

Scaled Dot-Product Attention

Vector quantization implementation. Currently supports only euclidean distance. Args: dim (int): Dimension codebook_size (int)

inputs --- [N, Ty/r, n_mels*r] mels outputs --- [N, ref_enc_gru_size]