aiter

AITER is AMD’s centralized repository that support various of high performance AI operators for AI workloads acceleration, where a good unified place for all the customer operator-level requests, which can match different customers' needs. Developers can focus on operators, and let the customers integrate this op collection into their own private/public/whatever framework.

Some summary of the features: * C++ level API * Python level API * The underneath kernel could from triton/ck/asm * Not only inference kernels, but also training kernels and gemm+comm kerenls (so can do any kerne+framework dirty WAs for any arch limit)

clone

git clone --recursive https://github.com/ROCm/aiter.git or git submodule sync ; git submodule update --init --recursive

install into python

under aiter root dir run: python3 setup.py develop

run operators supported by aiter

there are number of op test, you can run them like this: python3 op_tests/test_layernorm2d.py | Ops | Description | |------------|---------------------------------------------------------------------------------------------| |GEMM | D=AxB+C | |FusedMoE | bf16 balabala | |WIP | coming soon... |