Test the time and CUDA memory consumption of PAM.

Test the time and CUDA memory consumption of Prob-sparse self attention.

If you want to thest former's flop, you need to give default value to inputs in model.forward(), the following code can only pass one argument to

SpeedUp version of Autocorrelation (a batch-normalization style design) This is for the inference phase.

SpeedUp version of Autocorrelation (a batch-normalization style design) This is for the training phase.

Returns a list of time features that will be appropriate for the given frequency string. Parameters ---------- freq_str Frequ

Returns a list of time features that will be appropriate for the given frequency string. Parameters ---------- freq_str Frequ

Returns a list of time features that will be appropriate for the given frequency string. Parameters ---------- freq_str Frequ

Start training.

Start training.

训练模型

Epoch operation in training phase.

Epoch operation in training phase.

Input: batch*seq_len. Output: batch*seq_len*d_model.

Results visualization

获取单个样本