↓ 2 callersFunctionrepeat_kv This is the equivalent of torch.repeat_interleave(x, dim=1, repeats=n_rep). The hidden states go from (batch, num_key_value_heads, seqlen, he
time_moe/models/modeling_time_moe.py:123
↓ 1 callersMethodprepare_inputs_for_generation(
self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, **kwargs
)
time_moe/models/modeling_time_moe.py:1108
Method__init__(self, dataset: TimeSeriesDataset, context_length: int, prediction_length: int = 0, stride: int = None, **kwra
time_moe/datasets/time_moe_window_dataset.py:40
Function_get_cosine_schedule_with_warmup_and_min_lr_lambda(
current_step: int, *, num_warmup_steps: int, num_training_steps: int, num_cycles: float, min_lr_rati
time_moe/trainer/hf_trainer.py:68