Replies: 1 comment
-
The Clear Model node allows you to exit the video memory of the ollama model at any location. You need to insert the Clear Model node between any connections and set the is_ollama to true |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
How do you set the
keep_alive
parameter for Ollama API? The default is 5, which keeps models loaded into vram memory for 5 minutes. If the user can set this to 0, then the models are immediately unloaded from vram memory after a request, freeing up vram for other tasks (like image generation).Beta Was this translation helpful? Give feedback.
All reactions