immich: Hardware-Accelerated Machine Learning about charts HOT 3 CLOSED

Fixed in 0534cad

from charts.

I don't think we have anything extra to do here.
At least for NVIDIA, all it needs is the GPU added and capabilities set.

Both of those are done automatically already.

Note: The yaml files Immich has on their docs is about docker-compose configuration, not something immich it self needs.

from charts.

Here are the logfiles from immich-machinelearning pod:
I am not sure but could it be that the wrong ml-image is used?

[03/30/24 23:28:36] INFO Starting gunicorn 21.2.0
[03/30/24 23:28:36] INFO Listening at: http://[::]:10003 (14)
[03/30/24 23:28:36] INFO Using worker: app.config.CustomUvicornWorker
[03/30/24 23:28:36] INFO Booting worker with pid: 78
[03/30/24 23:28:42] INFO Started server process [78]
[03/30/24 23:28:42] INFO Waiting for application startup.
[03/30/24 23:28:42] INFO Created in-memory cache with unloading after 300s
of inactivity.
[03/30/24 23:28:42] INFO Initialized request thread pool with 80 threads.
[03/30/24 23:28:42] INFO Application startup complete.
[03/31/24 13:32:19] INFO Setting 'nllb-clip-large-siglip__v1' execution
providers to ['CPUExecutionProvider'], in
descending order of preference
[03/31/24 13:32:19] INFO Downloading clip model
'nllb-clip-large-siglip__v1'. This may take a
while.
[03/31/24 13:32:19] INFO Setting 'antelopev2' execution providers to
['CPUExecutionProvider'], in descending order of
preference
Fetching 523 files: 100%|██████████| 523/523 [00:47<00:00, 11.06it/s]
[03/31/24 13:33:08] INFO Loading clip model 'nllb-clip-large-siglip__v1' to
memory
[03/31/24 13:33:13] INFO Downloading facial recognition model 'antelopev2'.
This may take a while.
Fetching 4 files: 100%|██████████| 4/4 [00:02<00:00, 1.35it/s]
[03/31/24 13:33:16] INFO Loading facial recognition model 'antelopev2' to
memory
[03/31/24 13:37:23] INFO Shutting down due to inactivity.
[03/31/24 13:37:23] INFO Shutting down
[03/31/24 13:37:24] INFO Waiting for application shutdown.
[03/31/24 13:37:24] INFO Application shutdown complete.
[03/31/24 13:37:24] INFO Finished server process [78]
[03/31/24 13:37:24] INFO Worker exiting (pid: 78)
[03/31/24 13:37:24] INFO Booting worker with pid: 780
[03/31/24 13:37:29] INFO Started server process [780]
[03/31/24 13:37:29] INFO Waiting for application startup.
[03/31/24 13:37:29] INFO Created in-memory cache with unloading after 300s
of inactivity.
[03/31/24 13:37:29] INFO Initialized request thread pool with 80 threads.
[03/31/24 13:37:29] INFO Application startup complete.
[03/31/24 15:33:14] INFO Setting 'nllb-clip-large-siglip__v1' execution
providers to ['CPUExecutionProvider'], in
descending order of preference
[03/31/24 15:33:14] INFO Loading clip model 'nllb-clip-large-siglip__v1' to
memory

This is the immich-machine-learning that is used:

docker.io/altran1502/immich-machine-learning@sha256:612e8856ad92f5915ececd5a67b76b7218f0fe4e41c72fcf1675bee76802294b

And this seems to be the default CPU image...

from charts.