AI & Agents

AMD Ships Loom v0.1 for Local AI on Its CPUs, GPUs and NPUs

Leave a comment

AMD tagged the first release of Loom, part of its ROCm HRX (HIP Runtime Extended) stack.

What it does

Loom is a compiler and IR stack that compiles kernels and device programs, links model programs, and specializes them for AMD CPUs, GPUs and NPUs. The hrx-loom SDK bundles the compiler, runtime, Python APIs and CLI tools. loom-fetch installs a model’s programs and assets, and loom-serve serves requests over HTTP. It targets AMDGPU HSA for GPUs and SPIR-V/Vulkan for portable execution, with x86 and WebAssembly still maturing. It’s on GitHub and on pip.

My take

One toolchain that covers the CPU, GPU and NPU on an AMD box is exactly what local AI on APUs needs. It’s v0.1, so expect rough edges. I’ll be watching how it compares to the back-ends people use today.

God Bless, and May the Source Be with You!

References & Further Reading

Subscribe (RSS) Follow AI & Agents via RSS

Leave a note

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.