mirror of
https://github.com/immich-app/immich.git
synced 2025-05-24 01:12:58 -04:00
2b37caba03
* feat(ml): introduce support of onnxruntime-rocm for AMD GPU
* try mutex for algo cache
use OrtMutex
* bump versions, run on mich
use 3.12
use 1.19.2
* acquire lock before any changes can be made
guard algo benchmark results
mark mutex as mutable
re-add /bin/sh (?)
use 3.10
use 6.1.2
* use composite cache key
1.19.2
fix variable name
fix variable reference
aaaaaaaaaaaaaaaaaaaa
* bump deps
* disable algo caching
* fix gha
* try ubuntu runner
* actually fix the gha
* update patch
* skip mimalloc preload for rocm
* increase build threads
* increase timeout for rocm
* Revert "increase timeout for rocm"
This reverts commit 2c4452f5d132198ed381a7b262b4a5cab5114b5f.
* attempt migraphx
* set migraphx_home
* Revert "set migraphx_home"
This reverts commit c121d3e48754b3bce100636f8d666deec58a44b7.
* Revert "attempt migraphx"
This reverts commit 521f9fb72dbe506dc6cb8faeb6494817d87265c6.
* migraphx, take two
* bump rocm
* allow cpu
* try only targeting migraphx
* skip tests
* migraph ❌
* known issues
* target gfx900 and gfx1102
* mention `HSA_USE_SVM`
* update lock
* set device id for rocm
---------
Co-authored-by: Mehdi GHESH <mehdi.ghesh@hotmail.fr>
32 lines
926 B
Bash
Executable File
32 lines
926 B
Bash
Executable File
#!/usr/bin/env sh
|
|
|
|
echo "Initializing Immich ML $IMMICH_SOURCE_REF"
|
|
|
|
if ! [ "$DEVICE" = "openvino" ]; then
|
|
: "${MACHINE_LEARNING_WORKER_TIMEOUT:=120}"
|
|
else
|
|
: "${MACHINE_LEARNING_WORKER_TIMEOUT:=300}"
|
|
fi
|
|
|
|
# mimalloc seems to increase memory usage dramatically with openvino, need to investigate
|
|
if ! [ "$DEVICE" = "openvino" ] && ! [ "$DEVICE" = "rocm" ]; then
|
|
lib_path="/usr/lib/$(arch)-linux-gnu/libmimalloc.so.2"
|
|
export LD_PRELOAD="$lib_path"
|
|
export LD_BIND_NOW=1
|
|
fi
|
|
|
|
: "${IMMICH_HOST:=[::]}"
|
|
: "${IMMICH_PORT:=3003}"
|
|
: "${MACHINE_LEARNING_WORKERS:=1}"
|
|
: "${MACHINE_LEARNING_HTTP_KEEPALIVE_TIMEOUT_S:=2}"
|
|
|
|
gunicorn app.main:app \
|
|
-k app.config.CustomUvicornWorker \
|
|
-c gunicorn_conf.py \
|
|
-b "$IMMICH_HOST":"$IMMICH_PORT" \
|
|
-w "$MACHINE_LEARNING_WORKERS" \
|
|
-t "$MACHINE_LEARNING_WORKER_TIMEOUT" \
|
|
--log-config-json log_conf.json \
|
|
--keep-alive "$MACHINE_LEARNING_HTTP_KEEPALIVE_TIMEOUT_S" \
|
|
--graceful-timeout 0
|