{"id":222463,"date":"2026-03-11T12:21:00","date_gmt":"2026-03-11T16:21:00","guid":{"rendered":"https:\/\/news-you-need.com\/index.php\/2026\/03\/11\/amd-ryzen-ai-npus-are-finally-useful-under-linux-for-running-llms\/"},"modified":"2026-03-11T15:05:12","modified_gmt":"2026-03-11T19:05:12","slug":"amd-ryzen-ai-npus-are-finally-useful-under-linux-for-running-llms","status":"publish","type":"post","link":"https:\/\/news-you-need.com\/index.php\/2026\/03\/11\/amd-ryzen-ai-npus-are-finally-useful-under-linux-for-running-llms\/","title":{"rendered":"AMD Ryzen AI NPUs Are Finally Useful Under Linux For Running LLMs"},"content":{"rendered":"

AMD Ryzen AI NPUs Are Finally Useful Under Linux For Running LLMs<\/a><\/p>\n

https:\/\/www.phoronix.com\/news\/AMD-Ryzen-AI-NPUs-Linux-LLMs<\/a><\/p>\n

Publish Date: 2026-03-11 12:21:00<\/a><\/p>\n

Source Domain: www.phoronix.com<\/a><\/p>\n

Over the past two years AMD has developed the AMDXDNA accelerator driver in the mainline Linux kernel for supporting the AMD Ryzen AI NPUs. But when it comes to user-space software on Linux actually able to leave the Ryzen AI NPUs it’s been… extremely limited with nothing really useful besides some niche bits of code. Even AMD’s own software like their GAIA on Linux has used Vulkan with their iGPUs rather than any NPU support. But finally today there is a significant shift with the Ryzen AI NPUs becoming useful on Linux and able to handle LLMs.<\/p>\n

The open-source Lemonade server for running LLMs today saw the release of Lemonade 10.0 and with it comes LInux NPU support for large language models as well as Whisper. Plus there is also native integration with Claude Code in Lemonade 10.0.
\n<\/p>\n

\"Lemonade<\/p>\n

Lemonade for its Linux Ryzen AI NPU support is building off FastFlowLM as a means to “unlock Ryzen AI NPUs” as an NPU-first runtime built exclusively for Ryzen AI. FlastFlowLM with current-gen Ryzen AI NPUs can support context lengths up to 256k tokens. FastFlowLM 0.9.35 released this morning and it comes with official native Linux support.<\/p>\n

\"FastFlowLM<\/p>\n

Besides the Lemonade 10.0 server and latest FastFlowLM runtime, you also need to be using the Linux 7.0 kernel or the AMDXDNA driver back-ports coming to existing stable kernel versions due to some last minute accelerator driver tweaks. This Ryzen AI NPU support on Linux should work with all current AMD Ryzen AI 300\/400 series SoCs.<\/p>\n

\"Lemonade<\/p>\n

There is this Lemonade documentation guide that outlines running LLMs on Linux with FastFlowLM and Lemonade.<\/p>\n

I’ll be giving this AMD Ryzen AI NPU support on Linux a try in the days ahead with the hardware I have available. (Sadly the HP ZBook Ultra G1a review sample needed to be returned long ago for the Ryzen AI Max+ 395 in laptop form, but there is always the Framework Desktop and then the Ryzen AI 300 Strix Point hardware I have in the lab.) Hopefully all goes well with this long-awaited Ryzen AI NPU Linux…<\/p>\n

Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

AMD Ryzen AI NPUs Are Finally Useful Under Linux For Running LLMs https:\/\/www.phoronix.com\/news\/AMD-Ryzen-AI-NPUs-Linux-LLMs Publish Date:…<\/p>\n","protected":false},"author":1,"featured_media":222464,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/www.phoronix.net\/image.php?id=2026&image=amd_npu_3","fifu_image_alt":"","footnotes":""},"categories":[48],"tags":[71],"class_list":["post-222463","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-linux","tag-linux"],"_links":{"self":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/222463"}],"collection":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/comments?post=222463"}],"version-history":[{"count":1,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/222463\/revisions"}],"predecessor-version":[{"id":222465,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/222463\/revisions\/222465"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/media\/222464"}],"wp:attachment":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/media?parent=222463"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/categories?post=222463"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/tags?post=222463"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}