
MoonMath AI open-sources HIP attention kernel that beats AMD on its own hardware
MoonMath AI has released an open-source bf16 forward attention kernel for AMD’s MI300X GPU that outperforms AMD’s own AITER v3 library on every tested shape and rounding mode. The kernel, written in HIP and released under the MIT licence, achieves geometric mean speedups of 1.18 times with RTNE rounding, 1.15 times with RTNA, and 1.08 […]










