add model cache after loaded

[efwfe]

Hello, I made a PR to cache model after loaded. save the model instance in memory, that's really will cost some memory here, but dont worry, it will check the memory free both cpu and gpu, and free the memory when it's necessary.
And this is the update version of #3545.

Here is a gif example to show it, and it's really amazing.

Fully tested on openart template workflows. -> https://openart.ai/workflows/templates

[alboto]

A bug here
model_cache.cache_clipvision needs to be changed to model_cache.cache_clip_vision

[jasstionzyf]

It is better to cache clipVision model also within CLIPVisionLoader
When use ip adapter every time will need to load CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors
Use model cache can directly copy it each time from cpu memory

[efwfe]

copy that.

[333caowei]

looks great ! how to use it?

[efwfe]

looks great ! how to use it?

You can try with this repo repository https://github.com/efwfe/ComfyUI.git,
The bigger the memory, the better performance.
Thank you for wanting to use.

[Charuru]

Hi can you keep your fork up to date please? I want to test this.

[efwfe]

Hi can you keep your fork up to date please? I want to test this.

Welcome to test it. It has been updated. Hope to know your feedback. It is recommended to add --low-vram parameter to reduce the memory usage of sdxl models.

[shawnL128Po]

Sorry for asking a silly question. I couldn't find the definition of the variable 'ckpt_path' in the function 'load_state_dict_guess_config' within the sd.py file, and PyCharm is reporting a compilation error: 'Unresolved reference 'ckpt_path''.

[efwfe]

Sorry for asking a silly question. I couldn't find the definition of the variable 'ckpt_path' in the function 'load_state_dict_guess_config' within the sd.py file, and PyCharm is reporting a compilation error: 'Unresolved reference 'ckpt_path''.

Sorry,that's my mistake, the latest version of comfyui remove the parameter of ckpt_path, I have updated the code, you can try it now.

Actually I'm ready to close this PR because it's not really helpful in most cases. So I closed this thanks you guys.

[WSvisionG]

I think it is very useful, I hope you can continue to update, thank you, cool