Cannot run docker_compose_GPU.yaml

[dukeofsir]

⚠️ Check for existing issues before proceeding. ⚠️

• I have searched the existing issues, and there is no existing issue for my problem

Where are you using SuperAGI?

Linux

Which branch of SuperAGI are you using?

Main

Do you use OpenAI GPT-3.5 or GPT-4?

GPT-3.5

Which area covers your issue best?

Installation and setup

Describe your issue.

I get the following error when trying to run the docker
_compose_gpu.yml script:

Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error mounting "/home/ty/Downloads/.huggingface/download/QwQ-32B-Preview-Q8_0.gguf" to rootfs at "/app/local_model_path": mount src=/home/ty/Downloads/.huggingface/download/QwQ-32B-Preview-Q8_0.gguf, dst=/app/local_model_path, dstFd=/proc/thread-self/fd/8, flags=0x5000: not a directory: unknown: Are you trying to mount a directory onto a file (or vice-versa)? Check if the specified host path exists and is the expected type

I am able to run the normal docker build command but not the GPU one.
I think that I am confused on line 5 and 27 of the docker_compose_gpu.yml. is "/app/local_model_path" verbatim?
That is what I suspect is the issue

How to replicate your Issue?

• open Suse tumbleweed updated with nvidia 3090 with nvidea driver & Nvidea-container-toolkit installed.
• edit docker_compose_gpu.yml with my path to model + ":/app/local_model_path"
• I put this in both of the appropriate places according to this video.
• Execute "sudo docker compose -f docker-compose-gpu.yml up --build"
• Error

Upload Error Log Content

Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error mounting "/home/ty/Downloads/.huggingface/download/QwQ-32B-Preview-Q8_0.gguf" to rootfs at "/app/local_model_path": mount src=/home/ty/Downloads/.huggingface/download/QwQ-32B-Preview-Q8_0.gguf, dst=/app/local_model_path, dstFd=/proc/thread-self/fd/8, flags=0x5000: not a directory: unknown: Are you trying to mount a directory onto a file (or vice-versa)? Check if the specified host path exists and is the expected type

[bluescountry]

im very new in here, and have some knowledge about docker then cmiiw

A. from error there is 2 problem possible

1. "host" problem in error log " Are you trying to mount a directory onto a file (or vice-versa)?" , maybe it can be dir/file if its dir and the continer except to be file then that error happen or if the continer except to be file and what you copy is /home/ty/Downloads/.huggingface/download/QwQ-32B-Preview-Q8_0.gguf dir(folder) then the error happen"

2. the docker container problem in error log "Are you trying to mount a directory onto a file (or vice-versa)?" its have less chance of the source of problem since that setup by who make repo but maybe the folder not make or something shit happen

the solution you can try in host

ls -l /home/ty/Downloads/.huggingface/download/QwQ-32B-Preview-Q8_0.gguf

If it's a file, the output will look like this:
-rw-r--r-- 1 ty ty 12345678 Oct 10 12:34 /home/ty/Downloads/.huggingface/download/QwQ-32B-Preview-Q8_0.gguf
(The first character is -, indicating it's a file.)

If it's a directory, the output will look like this:

drwxr-xr-x 2 ty ty 4096 Oct 10 12:34 /home/ty/Downloads/.huggingface/download/QwQ-32B-Preview-Q8_0.gguf

on container side

/app/local_model_path:

docker run --rm -it /bin/sh
Inside the container, run:

ls -l /app/local_model_path
If it's a file, the output will start with -.

If it's a directory, the output will start with d.

but since you fail the build you cant run the docker container. just try verify the host and if its dir(folder) try to cd it and ls the filename in here (assume the continer except the file not dir)