This function construct the position index to reuse symmetrical parameters of the position bias

Inference code, describing the algorithm of inference using models with different lead times. PanguModel24, PanguModel6, PanguModel3 and PanguMode

Generate random Perlin noise: we follow https://github.com/pvigier/perlin-numpy/ to calculate the perlin noise.

Training code

Patch embedding operation

Patch recovery operation

Down-sampling operation

Up-sampling operation

Basic layer of our network, contains 2 or 6 blocks

3D transformer block with Earth-Specific bias and window attention, see https://github.com/microsoft/Swin-Transformer for the official imp

3D window attention with the Earth-Specific bias, see https://github.com/microsoft/Swin-Transformer for the official implementation of 2D

MLP layers, same as most vision transformer architectures.

Backbone architecture