{"id":625,"date":"2025-02-09T18:00:46","date_gmt":"2025-02-09T18:00:46","guid":{"rendered":"https:\/\/blog.syddel.uk\/?p=625"},"modified":"2025-04-25T20:44:39","modified_gmt":"2025-04-25T19:44:39","slug":"hardware-accelerated-ollama-on-amd","status":"publish","type":"post","link":"https:\/\/blog.syddel.uk\/?p=625","title":{"rendered":"Ollama Running on AMD GPUs"},"content":{"rendered":"\n<p>This is a quick guide on enabling GPU hardware acceleration for Ollama on AMD GPUs (using the open source <code>amdgpu<\/code> driver that comes with the kernel, not the proprietary AMD drivers). Supported AMD GPUs are listed <a href=\"https:\/\/github.com\/ollama\/ollama\/blob\/main\/docs\/gpu.md#amd-radeon\">here<\/a>.<\/p>\n\n\n\n<p>It is sometimes possible to get GPU hardware acceleration working on Linux with AMD GPUs that are not listed as officially supported. <strong>However, be aware that this can lead to system instability<\/strong>. I have successfully used this method on:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A desktop PC with an ancient Radeon RX 5500 XT with 8GB of VRAM.<\/li>\n\n\n\n<li>A laptop with a Ryzen 7 4800H (Vega 7 iGPU).<\/li>\n\n\n\n<li>A laptop with a Ryzen 7 8840U (Radeon RX 780m).<\/li>\n\n\n\n<li>A laptop with a Ryzen 7 8845HS (which also has a Radeon RX 780m).<\/li>\n<\/ul>\n\n\n\n<p>This guide is written for Arch Linux, but should be easy enough to use for other (inferior) Linux distros.<\/p>\n\n\n\n<p class=\"has-large-font-size\">Installation<\/p>\n\n\n\n<p>Install the following ROCm packages:<\/p>\n\n\n\n<div superb-addons-animation=\"rotateIn\" class=\"wp-block-kevinbatdorf-code-block-pro\" data-code-block-pro-font-family=\"Code-Pro-JetBrains-Mono\" style=\"font-size:.875rem;font-family:Code-Pro-JetBrains-Mono,ui-monospace,SFMono-Regular,Menlo,Monaco,Consolas,monospace;--cbp-line-number-width:calc(1 * 0.6 * .875rem);line-height:1.25rem;--cbp-tab-width:2;tab-size:var(--cbp-tab-width, 2);opacity: 0;\"><span role=\"button\" tabindex=\"0\" data-code=\"$ sudo pacman -S rocminfo rocm-opencl-sdk rocm-hip-sdk rocm-ml-sdk\" style=\"color:#adbac7;display:none\" aria-label=\"Copy\" class=\"code-block-pro-copy-button\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" style=\"width:24px;height:24px\" fill=\"none\" viewBox=\"0 0 24 24\" stroke=\"currentColor\" stroke-width=\"2\"><path class=\"with-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2m-6 9l2 2 4-4\"><\/path><path class=\"without-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2\"><\/path><\/svg><\/span><pre class=\"shiki github-dark-dimmed\" style=\"background-color: #22272e\" tabindex=\"0\"><code><span class=\"line\"><span style=\"color: #F69D50\">$<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">sudo<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">pacman<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">-S<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">rocminfo<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">rocm-opencl-sdk<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">rocm-hip-sdk<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">rocm-ml-sdk<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n<p>Install Ollama with ROCm support:<\/p>\n\n\n\n<div superb-addons-animation=\"rotateIn\" class=\"wp-block-kevinbatdorf-code-block-pro\" data-code-block-pro-font-family=\"Code-Pro-JetBrains-Mono\" style=\"font-size:.875rem;font-family:Code-Pro-JetBrains-Mono,ui-monospace,SFMono-Regular,Menlo,Monaco,Consolas,monospace;line-height:1.25rem;--cbp-tab-width:2;tab-size:var(--cbp-tab-width, 2);opacity: 0;\"><span role=\"button\" tabindex=\"0\" data-code=\"$ sudo pacman -S ollama-rocm\" style=\"color:#adbac7;display:none\" aria-label=\"Copy\" class=\"code-block-pro-copy-button\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" style=\"width:24px;height:24px\" fill=\"none\" viewBox=\"0 0 24 24\" stroke=\"currentColor\" stroke-width=\"2\"><path class=\"with-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2m-6 9l2 2 4-4\"><\/path><path class=\"without-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2\"><\/path><\/svg><\/span><pre class=\"shiki github-dark-dimmed\" style=\"background-color: #22272e\" tabindex=\"0\"><code><span class=\"line\"><span style=\"color: #F69D50\">$<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">sudo<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">pacman<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">-S<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ollama-rocm<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n<p>If your AMD GPU is supported, then that&#8217;s all you have to do!<\/p>\n\n\n\n<p>Load an Ollama model:<\/p>\n\n\n\n<div superb-addons-animation=\"rotateIn\" class=\"wp-block-kevinbatdorf-code-block-pro\" data-code-block-pro-font-family=\"Code-Pro-JetBrains-Mono\" style=\"font-size:.875rem;font-family:Code-Pro-JetBrains-Mono,ui-monospace,SFMono-Regular,Menlo,Monaco,Consolas,monospace;line-height:1.25rem;--cbp-tab-width:2;tab-size:var(--cbp-tab-width, 2);opacity: 0;\"><span role=\"button\" tabindex=\"0\" data-code=\"$ ollama list\n\nNAME                     ID              SIZE      MODIFIED     \ncodegeex4:latest         867b8e81d038    5.5 GB    16 hours ago    \ndeepseek-coder:6.7b      ce298d984115    3.8 GB    16 hours ago    \ntinyllama:latest         2644915ede35    637 MB    16 hours ago    \nyi-coder:1.5b            186c460ee707    866 MB    16 hours ago    \nyi-coder:9b              39c63e7675d7    5.0 GB    16 hours ago    \ndeepseek-coder:latest    3ddd2d3fc8d2    776 MB    16 hours ago    \ndeepseek-r1:1.5b         a42b25d8c10a    1.1 GB    16 hours ago    \ndeepseek-r1:latest       0a8c26691023    4.7 GB    16 hours ago    \n\n$ ollama run deepseek-r1:1.5b\n&gt;&gt;&gt; Send a message (\/? for help)\" style=\"color:#adbac7;display:none\" aria-label=\"Copy\" class=\"code-block-pro-copy-button\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" style=\"width:24px;height:24px\" fill=\"none\" viewBox=\"0 0 24 24\" stroke=\"currentColor\" stroke-width=\"2\"><path class=\"with-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2m-6 9l2 2 4-4\"><\/path><path class=\"without-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2\"><\/path><\/svg><\/span><pre class=\"shiki github-dark-dimmed\" style=\"background-color: #22272e\" tabindex=\"0\"><code><span class=\"line\"><span style=\"color: #F69D50\">$<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ollama<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">list<\/span><\/span>\n<span class=\"line\"><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">NAME<\/span><span style=\"color: #ADBAC7\">                     <\/span><span style=\"color: #96D0FF\">ID<\/span><span style=\"color: #ADBAC7\">              <\/span><span style=\"color: #96D0FF\">SIZE<\/span><span style=\"color: #ADBAC7\">      <\/span><span style=\"color: #96D0FF\">MODIFIED<\/span><span style=\"color: #ADBAC7\">     <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">codegeex4:latest<\/span><span style=\"color: #ADBAC7\">         <\/span><span style=\"color: #6CB6FF\">867<\/span><span style=\"color: #96D0FF\">b8e81d038<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">5.5<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">GB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">16<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">hours<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ago<\/span><span style=\"color: #ADBAC7\">    <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">deepseek-coder:6.7b<\/span><span style=\"color: #ADBAC7\">      <\/span><span style=\"color: #96D0FF\">ce298d984115<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">3.8<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">GB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">16<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">hours<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ago<\/span><span style=\"color: #ADBAC7\">    <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">tinyllama:latest<\/span><span style=\"color: #ADBAC7\">         <\/span><span style=\"color: #6CB6FF\">2644915<\/span><span style=\"color: #96D0FF\">ede35<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">637<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">MB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">16<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">hours<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ago<\/span><span style=\"color: #ADBAC7\">    <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">yi-coder:1.5b<\/span><span style=\"color: #ADBAC7\">            <\/span><span style=\"color: #6CB6FF\">186<\/span><span style=\"color: #96D0FF\">c460ee707<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">866<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">MB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">16<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">hours<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ago<\/span><span style=\"color: #ADBAC7\">    <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">yi-coder:9b<\/span><span style=\"color: #ADBAC7\">              <\/span><span style=\"color: #6CB6FF\">39<\/span><span style=\"color: #96D0FF\">c63e7675d7<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">5.0<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">GB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">16<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">hours<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ago<\/span><span style=\"color: #ADBAC7\">    <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">deepseek-coder:latest<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">3<\/span><span style=\"color: #96D0FF\">ddd2d3fc8d2<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">776<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">MB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">16<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">hours<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ago<\/span><span style=\"color: #ADBAC7\">    <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">deepseek-r1:1.5b<\/span><span style=\"color: #ADBAC7\">         <\/span><span style=\"color: #96D0FF\">a42b25d8c10a<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">1.1<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">GB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">16<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">hours<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ago<\/span><span style=\"color: #ADBAC7\">    <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">deepseek-r1:latest<\/span><span style=\"color: #ADBAC7\">       <\/span><span style=\"color: #6CB6FF\">0<\/span><span style=\"color: #96D0FF\">a8c26691023<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">4.7<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">GB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">16<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">hours<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ago<\/span><span style=\"color: #ADBAC7\">    <\/span><\/span>\n<span class=\"line\"><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">$<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ollama<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">run<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">deepseek-r1:1.5b<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">&gt;&gt;&gt; <\/span><span style=\"color: #F69D50\">Send<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">a<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">message<\/span><span style=\"color: #ADBAC7\"> (\/? <\/span><span style=\"color: #96D0FF\">for<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">help<\/span><span style=\"color: #ADBAC7\">)<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n<p>Open another terminal window and check that Ollama is using the GPU:<\/p>\n\n\n\n<div superb-addons-animation=\"rotateIn\" class=\"wp-block-kevinbatdorf-code-block-pro\" data-code-block-pro-font-family=\"Code-Pro-JetBrains-Mono\" style=\"font-size:.875rem;font-family:Code-Pro-JetBrains-Mono,ui-monospace,SFMono-Regular,Menlo,Monaco,Consolas,monospace;line-height:1.25rem;--cbp-tab-width:2;tab-size:var(--cbp-tab-width, 2);opacity: 0;\"><span role=\"button\" tabindex=\"0\" data-code=\"$ ollama ps\n\nNAME                ID              SIZE      PROCESSOR    UNTIL              \ndeepseek-r1:1.5b    a42b25d8c10a    2.0 GB    100% GPU     4 minutes from now  \" style=\"color:#adbac7;display:none\" aria-label=\"Copy\" class=\"code-block-pro-copy-button\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" style=\"width:24px;height:24px\" fill=\"none\" viewBox=\"0 0 24 24\" stroke=\"currentColor\" stroke-width=\"2\"><path class=\"with-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2m-6 9l2 2 4-4\"><\/path><path class=\"without-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2\"><\/path><\/svg><\/span><pre class=\"shiki github-dark-dimmed\" style=\"background-color: #22272e\" tabindex=\"0\"><code><span class=\"line\"><span style=\"color: #F69D50\">$<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ollama<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ps<\/span><\/span>\n<span class=\"line\"><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">NAME<\/span><span style=\"color: #ADBAC7\">                <\/span><span style=\"color: #96D0FF\">ID<\/span><span style=\"color: #ADBAC7\">              <\/span><span style=\"color: #96D0FF\">SIZE<\/span><span style=\"color: #ADBAC7\">      <\/span><span style=\"color: #96D0FF\">PROCESSOR<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #96D0FF\">UNTIL<\/span><span style=\"color: #ADBAC7\">              <\/span><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">deepseek-r1:1.5b<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #96D0FF\">a42b25d8c10a<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">2.0<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">GB<\/span><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #6CB6FF\">100<\/span><span style=\"color: #96D0FF\">%<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">GPU<\/span><span style=\"color: #ADBAC7\">     <\/span><span style=\"color: #6CB6FF\">4<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">minutes<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">from<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">now<\/span><span style=\"color: #ADBAC7\">  <\/span><\/span><\/code><\/pre><\/div>\n\n\n\n<p class=\"has-large-font-size\">Unsupported GPUs (Radeon RX 780m iGPU)<\/p>\n\n\n\n<p>Unsupported AMD GPUs can sometimes be used on Linux by using the <code><strong>HSA_OVERRIDE_GFX_VERSION<\/strong><\/code> environment variable.<\/p>\n\n\n\n<p>The Radeon RX 780m I have in my laptop is not listed in the supported GPUs. As mentioned in the link above, it&#8217;s still sometimes possible to get unsupported AMD GPUs working with Ollama (although it can sometimes lead to system instability).<\/p>\n\n\n\n<p><strong>IMPORTANT<\/strong>: Initially, this method did not work for me because my BIOS did not include an option to select the amount of VRAM to reserve for the iGPU (it was stuck at 512MB, and couldn&#8217;t be changed). You need at least 4GB of VRAM for hardware acceleration to work with AMD GPUs (depending on the model you&#8217;re running). I had to download and install a compatible BIOS from the OEM&#8217;s website. Only do this if you have nerves of steel, as there is a chance you could brick your laptop.<\/p>\n\n\n\n<p>Find out the model of your LLVM model of your AMD GPU:<\/p>\n\n\n\n<div superb-addons-animation=\"rotateIn\" class=\"wp-block-kevinbatdorf-code-block-pro\" data-code-block-pro-font-family=\"Code-Pro-JetBrains-Mono\" style=\"font-size:.875rem;font-family:Code-Pro-JetBrains-Mono,ui-monospace,SFMono-Regular,Menlo,Monaco,Consolas,monospace;line-height:1.25rem;--cbp-tab-width:2;tab-size:var(--cbp-tab-width, 2);opacity: 0;\"><span role=\"button\" tabindex=\"0\" data-code=\"$ glxinfo | grep -iA9 'extended renderer'\n\nExtended renderer info (GLX_MESA_query_renderer):\n    Vendor: AMD (0x1002)\n    Device: AMD Radeon Graphics (radeonsi, gfx1103_r1, LLVM 19.1.7, DRM 3.59, 6.13.1-arch2-1) (0x1900)\n    Version: 24.3.4\n    Accelerated: yes\n    Video memory: 8192MB\n    Unified memory: no\n    Preferred profile: core (0x1)\n    Max core profile version: 4.6\n    Max compat profile version: 4.6\" style=\"color:#adbac7;display:none\" aria-label=\"Copy\" class=\"code-block-pro-copy-button\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" style=\"width:24px;height:24px\" fill=\"none\" viewBox=\"0 0 24 24\" stroke=\"currentColor\" stroke-width=\"2\"><path class=\"with-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2m-6 9l2 2 4-4\"><\/path><path class=\"without-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2\"><\/path><\/svg><\/span><pre class=\"shiki github-dark-dimmed\" style=\"background-color: #22272e\" tabindex=\"0\"><code><span class=\"line\"><span style=\"color: #F69D50\">$<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">glxinfo<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #F47067\">|<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #F69D50\">grep<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">-iA9<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">&#39;extended renderer&#39;<\/span><\/span>\n<span class=\"line\"><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">Extended<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">renderer<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">info<\/span><span style=\"color: #ADBAC7\"> (GLX_MESA_query_renderer):<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Vendor:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">AMD<\/span><span style=\"color: #ADBAC7\"> (0x1002)<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Device:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">AMD<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">Radeon<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">Graphics<\/span><span style=\"color: #ADBAC7\"> (radeonsi, <\/span><span style=\"color: #96D0FF\">gfx1103_r1,<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">LLVM<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">19.1<\/span><span style=\"color: #96D0FF\">.7,<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">DRM<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">3.59<\/span><span style=\"color: #96D0FF\">,<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">6.13<\/span><span style=\"color: #96D0FF\">.1-arch2-1<\/span><span style=\"color: #ADBAC7\">) (<\/span><span style=\"color: #F69D50\">0x1900<\/span><span style=\"color: #ADBAC7\">)<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Version:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">24.3<\/span><span style=\"color: #96D0FF\">.4<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Accelerated:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">yes<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Video<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">memory:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">8192<\/span><span style=\"color: #96D0FF\">MB<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Unified<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">memory:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">no<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Preferred<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">profile:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">core<\/span><span style=\"color: #ADBAC7\"> (0x1)<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Max<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">core<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">profile<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">version:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">4.6<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">    <\/span><span style=\"color: #F69D50\">Max<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">compat<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">profile<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">version:<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #6CB6FF\">4.6<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n<p>From the above, my GPU is a <strong>gfx1103_r1<\/strong>, which equates to LLVM target <strong>11.0.3<\/strong> (which isn&#8217;t listed as a supported AMD GPU on the Ollama github page).<\/p>\n\n\n\n<p>I assumed that I needed set  <code>HSA_OVERRIDE_GFX_VERSION<\/code> to 11.0.3:<\/p>\n\n\n\n<div superb-addons-animation=\"rotateIn\" class=\"wp-block-kevinbatdorf-code-block-pro\" data-code-block-pro-font-family=\"Code-Pro-JetBrains-Mono\" style=\"font-size:.875rem;font-family:Code-Pro-JetBrains-Mono,ui-monospace,SFMono-Regular,Menlo,Monaco,Consolas,monospace;line-height:1.25rem;--cbp-tab-width:2;tab-size:var(--cbp-tab-width, 2);opacity: 0;\"><span role=\"button\" tabindex=\"0\" data-code=\"$ sudo systemctl edit ollama.service\n\n...\n[Service]\nEnvironment=&quot;HSA_OVERRIDE_GFX_VERSION=11.0.3&quot;\n...\n\n$ sudo systemctl restart ollama.service\n\" style=\"color:#adbac7;display:none\" aria-label=\"Copy\" class=\"code-block-pro-copy-button\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" style=\"width:24px;height:24px\" fill=\"none\" viewBox=\"0 0 24 24\" stroke=\"currentColor\" stroke-width=\"2\"><path class=\"with-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2m-6 9l2 2 4-4\"><\/path><path class=\"without-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2\"><\/path><\/svg><\/span><pre class=\"shiki github-dark-dimmed\" style=\"background-color: #22272e\" tabindex=\"0\"><code><span class=\"line\"><span style=\"color: #F69D50\">$<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">sudo<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">systemctl<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">edit<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ollama.service<\/span><\/span>\n<span class=\"line\"><\/span>\n<span class=\"line\"><span style=\"color: #6CB6FF\">...<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">[Service]<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Environment<\/span><span style=\"color: #F47067\">=<\/span><span style=\"color: #96D0FF\">&quot;HSA_OVERRIDE_GFX_VERSION=11.0.3&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #6CB6FF\">...<\/span><\/span>\n<span class=\"line\"><\/span>\n<span class=\"line\"><span style=\"color: #F69D50\">$<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">sudo<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">systemctl<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">restart<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #96D0FF\">ollama.service<\/span><\/span>\n<span class=\"line\"><\/span><\/code><\/pre><\/div>\n\n\n\n<p>This did not work. Looking at the Ollama logs I could see what the problem was:<\/p>\n\n\n\n<div superb-addons-animation=\"rotateIn\" class=\"wp-block-kevinbatdorf-code-block-pro\" data-code-block-pro-font-family=\"Code-Pro-JetBrains-Mono\" style=\"font-size:.875rem;font-family:Code-Pro-JetBrains-Mono,ui-monospace,SFMono-Regular,Menlo,Monaco,Consolas,monospace;line-height:1.25rem;--cbp-tab-width:2;tab-size:var(--cbp-tab-width, 2);opacity: 0;\"><span role=\"button\" tabindex=\"0\" data-code=\"$ sudo journalctl -fu ollama.service\n\n...\nFeb 09 14:35:13 lafite ollama[16809]: rocBLAS error: Cannot read \/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary.dat: Illegal seek for GPU arch : gfx1103\nFeb 09 14:35:13 lafite ollama[16809]:  List of available TensileLibrary Files :\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx908.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1012.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1010.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx900.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1102.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx942.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx941.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx90a.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx940.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx906.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1100.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1030.dat&quot;\nFeb 09 14:35:13 lafite ollama[16809]: &quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1101.dat&quot;\nFeb 09 14:35:14 lafite systemd-coredump[16855]: [\ud83e\udc55] Process 16845 (ollama_llama_se) of user 966 dumped core.\nFeb 09 14:35:14 lafite ollama[16809]: time=2025-02-09T14:35:14.993Z level=ERROR source=sched.go:455 msg=&quot;error loading llama server&quot; error=&quot;llama runner process has terminated: error:Cannot read \/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary.dat: Illegal seek for GPU arch : gfx1103&quot;\n...\" style=\"color:#adbac7;display:none\" aria-label=\"Copy\" class=\"code-block-pro-copy-button\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" style=\"width:24px;height:24px\" fill=\"none\" viewBox=\"0 0 24 24\" stroke=\"currentColor\" stroke-width=\"2\"><path class=\"with-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2m-6 9l2 2 4-4\"><\/path><path class=\"without-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M9 5H7a2 2 0 00-2 2v12a2 2 0 002 2h10a2 2 0 002-2V7a2 2 0 00-2-2h-2M9 5a2 2 0 002 2h2a2 2 0 002-2M9 5a2 2 0 012-2h2a2 2 0 012 2\"><\/path><\/svg><\/span><pre class=\"shiki github-dark-dimmed\" style=\"background-color: #22272e\" tabindex=\"0\"><code><span class=\"line\"><span style=\"color: #ADBAC7\">$ sudo journalctl -fu ollama.service<\/span><\/span>\n<span class=\"line\"><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">...<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: rocBLAS error: Cannot read \/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary.dat: Illegal seek for GPU arch : gfx1103<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]:  List of available TensileLibrary Files :<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx908.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1012.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1010.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx900.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1102.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx942.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx941.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx90a.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx940.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx906.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1100.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1030.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:13 lafite ollama[16809]: <\/span><span style=\"color: #96D0FF\">&quot;\/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary_lazy_gfx1101.dat&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:14 lafite systemd-coredump[16855]: [\ud83e\udc55] Process 16845 (ollama_llama_se) of user 966 dumped core.<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">Feb 09 14:35:14 lafite ollama[16809]: <\/span><span style=\"color: #F47067\">time<\/span><span style=\"color: #ADBAC7\">=2025-02-09T14:35:14.993Z <\/span><span style=\"color: #F47067\">level<\/span><span style=\"color: #ADBAC7\">=ERROR <\/span><span style=\"color: #F47067\">source<\/span><span style=\"color: #ADBAC7\">=sched.go:455 <\/span><span style=\"color: #F47067\">msg<\/span><span style=\"color: #ADBAC7\">=<\/span><span style=\"color: #96D0FF\">&quot;error loading llama server&quot;<\/span><span style=\"color: #ADBAC7\"> <\/span><span style=\"color: #F47067\">error<\/span><span style=\"color: #ADBAC7\">=<\/span><span style=\"color: #96D0FF\">&quot;llama runner process has terminated: error:Cannot read \/opt\/rocm\/lib\/rocblas\/library\/TensileLibrary.dat: Illegal seek for GPU arch : gfx1103&quot;<\/span><\/span>\n<span class=\"line\"><span style=\"color: #ADBAC7\">...<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n<p>Based on this, I decided to set <code>HSA_OVERRIDE_GFX_VERSION<\/code> to 11.0.2 (which looked available), and it worked! I confirmed Ollama was using the GPU by running <code>ollama ps<\/code> in another terminal tab, and by looking at <code>nvtop<\/code> after entering a prompt into Ollama:<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"500\" src=\"https:\/\/blog.syddel.uk\/wp-content\/uploads\/2025\/02\/nvtop-output-ollama-1024x500.png\" alt=\"\" class=\"wp-image-670\" srcset=\"https:\/\/blog.syddel.uk\/wp-content\/uploads\/2025\/02\/nvtop-output-ollama-1024x500.png 1024w, https:\/\/blog.syddel.uk\/wp-content\/uploads\/2025\/02\/nvtop-output-ollama-300x146.png 300w, https:\/\/blog.syddel.uk\/wp-content\/uploads\/2025\/02\/nvtop-output-ollama-768x375.png 768w, https:\/\/blog.syddel.uk\/wp-content\/uploads\/2025\/02\/nvtop-output-ollama-1536x749.png 1536w, https:\/\/blog.syddel.uk\/wp-content\/uploads\/2025\/02\/nvtop-output-ollama.png 1613w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p class=\"has-large-font-size\">Stability<\/p>\n\n\n\n<p>As mentioned (warned) &#8211; when you use an unsupported GPU, there are no guarantees your system will be stable. When I run Ollama on my desktop (which has the RX 5500 XT), I don&#8217;t have to set the <code><strong>HSA_OVERRIDE_GFX_VERSION<\/strong><\/code> environment variable (the card is automatically detected). However, if I play a video in Firefox, which uses video hardware acceleration for video playback, then my system will become unusable within a couple of minutes after entering a prompt into Ollama. To avoid this, I have to turn off GPU hardware acceleration in Firefox (or use Chromium, which still doesn&#8217;t have GPU hardware acceleration for AMD on Linux).<\/p>\n\n\n\n<p>I haven&#8217;t yet had the chance to compare the CPU-only vs GPU-only performance of Ollama on my systems, but will do this in the near future.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This is a quick guide on enabling GPU hardware acceleration for Ollama on AMD GPUs (using the open source amdgpu driver that comes with the kernel, not the proprietary AMD drivers). Supported AMD GPUs are listed here. It is sometimes possible to get GPU hardware acceleration working on Linux with AMD GPUs that are not<a class=\"moretag\" href=\"https:\/\/blog.syddel.uk\/?p=625\"><span class=\"screen-reader-text\">Read more about Ollama Running on AMD GPUs<\/span>[&#8230;]<\/a><\/p>\n","protected":false},"author":1,"featured_media":843,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21,19,16],"tags":[],"class_list":["post-625","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-coding","category-configuration"],"_links":{"self":[{"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=\/wp\/v2\/posts\/625","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=625"}],"version-history":[{"count":61,"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=\/wp\/v2\/posts\/625\/revisions"}],"predecessor-version":[{"id":856,"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=\/wp\/v2\/posts\/625\/revisions\/856"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=\/wp\/v2\/media\/843"}],"wp:attachment":[{"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=625"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=625"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.syddel.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=625"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}