{"id":6774,"date":"2026-06-21T00:21:45","date_gmt":"2026-06-20T16:21:45","guid":{"rendered":"https:\/\/www.alfredivy.sg\/blogger\/?p=6774"},"modified":"2026-06-21T00:21:47","modified_gmt":"2026-06-20T16:21:47","slug":"lets-give-immich-some-gpu","status":"publish","type":"post","link":"https:\/\/www.alfredivy.sg\/blogger\/2026\/06\/lets-give-immich-some-gpu\/","title":{"rendered":"Let&#8217;s give Immich some GPU"},"content":{"rendered":"\n<p class=\"has-drop-cap wp-block-paragraph\">Immich uses machine learning to extract info like text and faces from the photos.  To aid this, it can use the GPU like any AI.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p class=\"wp-block-paragraph\">In the docker compose file, add the following in bold.  Note the indentations are sensitive.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>immich-machine-learning:\n  image: ghcr.io\/immich-app\/immich-machine-learning:release<strong>-openvino<\/strong>\n<strong>  devices:\n    - \/dev\/dri:\/dev\/dri<\/strong><\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Start the container by<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>docker compose up -d<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Check if <code>\/dev\/dri<\/code> is available inside the container<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>docker exec -it immich_machine_learning ls \/dev\/dri<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">There should be <\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>card0<br>renderD128<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">I got <\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>by-path\ncard0<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Install the GPU drivers<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo apt install mesa-utils -y\nsudo apt install intel-gpu-tools -y\nlspci | grep -i vga<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">It should return<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>00:02.0 VGA compatible controller: Intel Corporation UHD Graphics 630<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Check the Docker OpenVINO status<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>docker exec -it immich_machine_learning python3 -c \"import onnxruntime as ort; print(ort.get_available_providers())\"<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Both of the following should be shown.  If it shows CPUExecution Provider only it means GPU support is not available.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>&#91;'OpenVINOExecutionProvider', 'CPUExecutionProvider']<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Immich machine learning is now running on the GPU.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Immich uses machine learning to extract info like text and faces from the photos. To aid this, it can use the GPU like any AI.<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[59],"tags":[611,634,624,635],"class_list":["post-6774","post","type-post","status-publish","format-standard","hentry","category-servers","tag-docker","tag-gpu","tag-immich","tag-machine-learning"],"_links":{"self":[{"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/posts\/6774","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/comments?post=6774"}],"version-history":[{"count":2,"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/posts\/6774\/revisions"}],"predecessor-version":[{"id":6776,"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/posts\/6774\/revisions\/6776"}],"wp:attachment":[{"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/media?parent=6774"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/categories?post=6774"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.alfredivy.sg\/blogger\/wp-json\/wp\/v2\/tags?post=6774"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}