Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ApplyCLIPSeg+ Input image size (352*352) doesn't match model (224*224). ERROR in PINOKIO Comfyui #5642

Closed
xdew77 opened this issue Nov 16, 2024 · 6 comments
Closed

ApplyCLIPSeg+ Input image size (352*352) doesn't match model (224*224). ERROR in PINOKIO Comfyui #5642

xdew77 opened this issue Nov 16, 2024 · 6 comments
Labels
User Support A user needs help with something, probably not a bug.

Comments

@xdew77
Copy link

xdew77 commented Nov 16, 2024

Your question

How can I solve this error "ApplyCLIPSeg+
Input image size (352352) doesn't match model (224224)." in PINOKIO ComfyUI?

thanks for any feedback.

Logs

# ComfyUI Error Report
## Error Details
- **Node ID:** 129
- **Node Type:** ApplyCLIPSeg+
- **Exception Type:** ValueError
- **Exception Message:** Input image size (352*352) doesn't match model (224*224).
## Stack Trace

  File "E:\pinokio\api\comfy.git\app\execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

  File "E:\pinokio\api\comfy.git\app\execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

  File "E:\pinokio\api\comfy.git\app\execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)

  File "E:\pinokio\api\comfy.git\app\execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))

  File "E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_essentials\segmentation.py", line 51, in execute
    out = model(**inputs)

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\transformers\models\clipseg\modeling_clipseg.py", line 1436, in forward
    vision_outputs = self.clip.vision_model(

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\transformers\models\clipseg\modeling_clipseg.py", line 870, in forward
    hidden_states = self.embeddings(pixel_values, interpolate_pos_encoding=interpolate_pos_encoding)

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)

  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\transformers\models\clipseg\modeling_clipseg.py", line 211, in forward
    raise ValueError(

System Information

  • ComfyUI Version: v0.2.7-24-g4ac401a
  • Arguments: main.py
  • OS: nt
  • Python Version: 3.10.15 | packaged by conda-forge | (main, Sep 20 2024, 16:26:40) [MSC v.1941 64 bit (AMD64)]
  • Embedded Python: false
  • PyTorch Version: 2.4.1+cu121

Devices

  • Name: cuda:0 NVIDIA GeForce RTX 4090 : cudaMallocAsync
    • Type: cuda
    • VRAM Total: 25756565504
    • VRAM Free: 9815120478
    • Torch VRAM Total: 14193524736
    • Torch VRAM Free: 8837726

Logs

2024-11-16T19:26:09.599120 - Scenedetect.available
2024-11-16T19:26:09.774272 - FishSpeech.available
2024-11-16T19:26:09.790286 - SenseVoice.available
2024-11-16T19:26:09.827320 - Whisper.available False
2024-11-16T19:26:09.829330 - fal-client## OK2024-11-16T19:26:09.829330 - 
2024-11-16T19:26:09.846337 - FalVideo.available
2024-11-16T19:26:09.846337 - �[93m -------------- �[0m
2024-11-16T19:26:10.433502 - Please 'pip install xformers'2024-11-16T19:26:10.433502 - 
2024-11-16T19:26:10.441510 - Nvidia APEX normalization not installed, using PyTorch LayerNorm2024-11-16T19:26:10.441510 - 
2024-11-16T19:26:10.574623 - Failed to auto update `Quality of Life Suit` 2024-11-16T19:26:10.574623 - 
2024-11-16T19:26:10.577626 - �[33mQualityOfLifeSuit_Omar92_DIR:�[0m E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-QualityOfLifeSuit_Omar922024-11-16T19:26:10.577626 - 
2024-11-16T19:26:10.596644 - E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-segment-anything-2\sam2\modeling\sam\transformer.py:20: UserWarning: Flash Attention is disabled as it requires a GPU with Ampere (8.0) CUDA capability.
  OLD_GPU, USE_FLASH_ATTN, MATH_KERNEL_ON = get_sdpa_settings()

2024-11-16T19:26:10.858882 - E:\pinokio\api\comfy.git\app2024-11-16T19:26:10.859882 - 
2024-11-16T19:26:10.859882 - ############################################2024-11-16T19:26:10.859882 - 
2024-11-16T19:26:10.859882 - E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-NAI-styler\CSV2024-11-16T19:26:10.859882 - 
2024-11-16T19:26:10.859882 - ############################################2024-11-16T19:26:10.859882 - 
2024-11-16T19:26:10.860883 - []2024-11-16T19:26:10.860883 - 
2024-11-16T19:26:10.860883 - ############################################2024-11-16T19:26:10.860883 - 
2024-11-16T19:26:10.932949 - ------------------------------------------2024-11-16T19:26:10.933950 - 
2024-11-16T19:26:10.933950 - �[34mComfyroll Studio v1.76 : �[92m 175 Nodes Loaded�[0m2024-11-16T19:26:10.933950 - 
2024-11-16T19:26:10.933950 - ------------------------------------------2024-11-16T19:26:10.933950 - 
2024-11-16T19:26:10.933950 - ** For changes, please see patch notes at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/blob/main/Patch_Notes.md2024-11-16T19:26:10.934951 - 
2024-11-16T19:26:10.934951 - ** For help, please see the wiki at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/wiki2024-11-16T19:26:10.934951 - 
2024-11-16T19:26:10.934951 - ------------------------------------------2024-11-16T19:26:10.934951 - 
2024-11-16T19:26:10.998008 - �[34mFizzleDorf Custom Nodes: �[92mLoaded�[0m2024-11-16T19:26:10.998008 - 
2024-11-16T19:26:11.307291 - All packages from requirements.txt are installed and up to date.2024-11-16T19:26:11.307291 - 
2024-11-16T19:26:11.317414 - llama-cpp installed2024-11-16T19:26:11.318301 - 
2024-11-16T19:26:11.319311 - All packages from requirements.txt are installed and up to date.2024-11-16T19:26:11.319311 - 
2024-11-16T19:26:11.457428 - Initializing ControlAltAI Nodes2024-11-16T19:26:11.457428 - 
2024-11-16T19:26:11.497465 - Please 'pip install xformers'2024-11-16T19:26:11.498466 - 
2024-11-16T19:26:11.507483 - Nvidia APEX normalization not installed, using PyTorch LayerNorm2024-11-16T19:26:11.507483 - 
2024-11-16T19:26:11.659621 - 
2024-11-16T19:26:11.659621 - �[92m[rgthree-comfy] Loaded 42 magnificent nodes. 🎉�[00m2024-11-16T19:26:11.660614 - 
2024-11-16T19:26:11.660614 - 
2024-11-16T19:26:13.405478 - �[34mWAS Node Suite: �[0mOpenCV Python FFMPEG support is enabled�[0m2024-11-16T19:26:13.405478 - 
2024-11-16T19:26:13.405478 - �[34mWAS Node Suite �[93mWarning: �[0m`ffmpeg_bin_path` is not set in `E:\pinokio\api\comfy.git\app\custom_nodes\was-node-suite-comfyui\was_suite_config.json` config file. Will attempt to use system ffmpeg binaries if available.�[0m2024-11-16T19:26:13.405478 - 
2024-11-16T19:26:15.095681 - �[34mWAS Node Suite: �[0mFinished.�[0m �[32mLoaded�[0m �[0m218�[0m �[32mnodes successfully.�[0m2024-11-16T19:26:15.095681 - 
2024-11-16T19:26:15.096682 - 
	�[3m�[93m"Do not wait for the opportunity. Create it."�[0m�[3m - George Bernard Shaw�[0m
2024-11-16T19:26:15.096682 - 
2024-11-16T19:26:15.139721 - 
Import times for custom nodes:
2024-11-16T19:26:15.140722 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\style_aligned_comfy
2024-11-16T19:26:15.140722 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\websocket_image_save.py
2024-11-16T19:26:15.140722 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\sdxl_prompt_styler
2024-11-16T19:26:15.141724 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\cg-use-everywhere
2024-11-16T19:26:15.141724 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_IPAdapter_plus
2024-11-16T19:26:15.141724 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUi_NNLatentUpscale
2024-11-16T19:26:15.141724 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-copilot
2024-11-16T19:26:15.141724 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\efficiency-nodes-comfyui
2024-11-16T19:26:15.142725 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-OmniGen
2024-11-16T19:26:15.142725 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\cg-image-picker
2024-11-16T19:26:15.142725 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\masquerade-nodes-comfyui
2024-11-16T19:26:15.142725 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Image-Saver
2024-11-16T19:26:15.142725 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_InstantID
2024-11-16T19:26:15.143726 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Universal-Styler
2024-11-16T19:26:15.143726 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-lama-remover
2024-11-16T19:26:15.143726 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfyui_controlnet_aux
2024-11-16T19:26:15.143726 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-sudo-latent-upscale
2024-11-16T19:26:15.143726 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Florence2
2024-11-16T19:26:15.144727 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ControlAltAI-Nodes
2024-11-16T19:26:15.144727 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_FizzNodes
2024-11-16T19:26:15.144727 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Video-Matting
2024-11-16T19:26:15.144727 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-tooling-nodes
2024-11-16T19:26:15.145727 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Florence-2
2024-11-16T19:26:15.145727 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Custom-Scripts
2024-11-16T19:26:15.145727 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-QualityOfLifeSuit_Omar92
2024-11-16T19:26:15.145727 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Impact-Pack
2024-11-16T19:26:15.146728 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_essentials
2024-11-16T19:26:15.146728 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfy-image-saver
2024-11-16T19:26:15.146728 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_UltimateSDUpscale
2024-11-16T19:26:15.146728 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\Derfuu_ComfyUI_ModdedNodes
2024-11-16T19:26:15.146728 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-KJNodes
2024-11-16T19:26:15.147729 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-utils-nodes
2024-11-16T19:26:15.147729 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_FaceAnalysis
2024-11-16T19:26:15.147729 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-GGUF
2024-11-16T19:26:15.147729 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-IC-Light
2024-11-16T19:26:15.147729 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\x-flux-comfyui
2024-11-16T19:26:15.148730 -    0.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\rgthree-comfy
2024-11-16T19:26:15.148730 -    0.1 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_Comfyroll_CustomNodes
2024-11-16T19:26:15.148730 -    0.1 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_Searge_LLM
2024-11-16T19:26:15.148730 -    0.1 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-tensorops
2024-11-16T19:26:15.149731 -    0.1 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-segment-anything-2
2024-11-16T19:26:15.149731 -    0.1 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\PuLID_ComfyUI
2024-11-16T19:26:15.149731 -    0.2 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_VLM_nodes
2024-11-16T19:26:15.149731 -    0.2 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_LayerStyle
2024-11-16T19:26:15.149731 -    0.3 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-PuLID-Flux-Enhanced
2024-11-16T19:26:15.150732 -    0.4 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-propost
2024-11-16T19:26:15.150732 -    0.5 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Merlin
2024-11-16T19:26:15.150732 -    0.8 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Manager
2024-11-16T19:26:15.150732 -    1.0 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Image-Filters
2024-11-16T19:26:15.150732 -    1.7 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-art-venture
2024-11-16T19:26:15.151733 -    2.2 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-mixlab-nodes
2024-11-16T19:26:15.151733 -    2.6 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Inspyrenet-Rembg
2024-11-16T19:26:15.151733 -    3.4 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\was-node-suite-comfyui
2024-11-16T19:26:15.151733 -    5.7 seconds: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Easy-Use
2024-11-16T19:26:15.151733 - 
2024-11-16T19:26:15.186764 - Starting server

2024-11-16T19:26:15.188766 - To see the GUI go to: http://127.0.0.1:8188
2024-11-16T19:26:20.519137 - E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-mixlab-nodes\webApp\lib/photoswipe-lightbox.esm.min.js2024-11-16T19:26:20.519137 - 
2024-11-16T19:26:20.600212 - FETCH DATA from: E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Manager\extension-node-map.json2024-11-16T19:26:20.603217 - 2024-11-16T19:26:20.616229 -  [DONE]2024-11-16T19:26:20.616229 - 
2024-11-16T19:26:20.664271 - E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-mixlab-nodes\webApp\lib/photoswipe.min.css2024-11-16T19:26:20.666274 - 
2024-11-16T19:26:20.671277 - E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-mixlab-nodes\webApp\lib/pickr.min.js2024-11-16T19:26:20.671277 - 
2024-11-16T19:26:20.730330 - E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-mixlab-nodes\webApp\lib/classic.min.css2024-11-16T19:26:20.730330 - 
2024-11-16T19:26:20.731333 - E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-mixlab-nodes\webApp\lib/model-viewer.min.js2024-11-16T19:26:20.732334 - 
2024-11-16T19:26:23.996540 - �[33mQualityOfLifeSuit_Omar92:�[0m:NSP ready2024-11-16T19:26:23.996540 - 
2024-11-16T19:26:23.998543 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:23.998543 - 
2024-11-16T19:26:23.999545 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:23.999545 - 
2024-11-16T19:26:23.999545 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:23.999545 - 
2024-11-16T19:26:23.999545 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.000546 - 
2024-11-16T19:26:24.000546 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.000546 - 
2024-11-16T19:26:24.000546 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.000546 - 
2024-11-16T19:26:24.144688 - []2024-11-16T19:26:24.144688 - 
2024-11-16T19:26:24.144688 - []2024-11-16T19:26:24.144688 - 
2024-11-16T19:26:24.193722 - E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-mixlab-nodes\webApp\lib/juxtapose.min.js2024-11-16T19:26:24.193722 - 
2024-11-16T19:26:24.194723 - E:\pinokio\api\comfy.git\app\custom_nodes\comfyui-mixlab-nodes\webApp\lib/juxtapose.css2024-11-16T19:26:24.194723 - 
2024-11-16T19:26:24.793278 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.793599 - 
2024-11-16T19:26:24.793599 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.793599 - 
2024-11-16T19:26:24.794602 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.794602 - 
2024-11-16T19:26:24.794602 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.794602 - 
2024-11-16T19:26:24.794602 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.795603 - 
2024-11-16T19:26:24.795603 - Error. No naistyles.csv found. Put your naistyles.csv in the custom_nodes/ComfyUI_NAI-mod/CSV directory of ComfyUI. Then press "Refresh".
                  Your current root directory is: E:\pinokio\api\comfy.git\app
            2024-11-16T19:26:24.795603 - 
2024-11-16T19:26:24.936733 - []2024-11-16T19:26:24.937732 - 
2024-11-16T19:26:24.937732 - []2024-11-16T19:26:24.937732 - 
2024-11-16T19:33:57.027183 - got prompt
2024-11-16T19:33:57.193334 - Warning torch.load doesn't support weights_only on this pytorch version, loading unsafely.
2024-11-16T19:33:57.883973 - model weight dtype torch.float16, manual cast: None
2024-11-16T19:33:57.885638 - model_type EPS
2024-11-16T19:33:59.579515 - Using pytorch attention in VAE
2024-11-16T19:33:59.582518 - Using pytorch attention in VAE
2024-11-16T19:33:59.982892 - Requested to load SDXLClipModel
2024-11-16T19:33:59.983884 - Loading 1 new model
2024-11-16T19:34:00.011911 - loaded completely 0.0 1560.802734375 True
2024-11-16T19:34:01.652127 - E:\pinokio\api\comfy.git\app\comfy\ldm\modules\attention.py:415: UserWarning: 1Torch was not compiled with flash attention. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\builder\windows\pytorch\aten\src\ATen\native\transformers\cuda\sdp_utils.cpp:555.)
  out = torch.nn.functional.scaled_dot_product_attention(q, k, v, attn_mask=mask, dropout_p=0.0, is_causal=False)

2024-11-16T19:34:05.003294 - Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}2024-11-16T19:34:05.003294 - 
2024-11-16T19:34:05.104384 - find model:2024-11-16T19:34:05.104384 -  2024-11-16T19:34:05.104384 - E:\pinokio\api\comfy.git\app\models\insightface\models\antelopev2\1k3d68.onnx2024-11-16T19:34:05.105386 -  2024-11-16T19:34:05.105386 - landmark_3d_682024-11-16T19:34:05.105386 -  2024-11-16T19:34:05.105386 - ['None', 3, 192, 192]2024-11-16T19:34:05.105386 -  2024-11-16T19:34:05.105386 - 0.02024-11-16T19:34:05.105386 -  2024-11-16T19:34:05.105386 - 1.02024-11-16T19:34:05.105386 - 
2024-11-16T19:34:05.159434 - Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}2024-11-16T19:34:05.159434 - 
2024-11-16T19:34:05.165449 - find model:2024-11-16T19:34:05.165449 -  2024-11-16T19:34:05.166441 - E:\pinokio\api\comfy.git\app\models\insightface\models\antelopev2\2d106det.onnx2024-11-16T19:34:05.166441 -  2024-11-16T19:34:05.166441 - landmark_2d_1062024-11-16T19:34:05.166441 -  2024-11-16T19:34:05.166441 - ['None', 3, 192, 192]2024-11-16T19:34:05.166441 -  2024-11-16T19:34:05.166441 - 0.02024-11-16T19:34:05.166441 -  2024-11-16T19:34:05.166441 - 1.02024-11-16T19:34:05.166441 - 
2024-11-16T19:34:05.201472 - Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}2024-11-16T19:34:05.201472 - 
2024-11-16T19:34:05.205476 - find model:2024-11-16T19:34:05.205476 -  2024-11-16T19:34:05.205476 - E:\pinokio\api\comfy.git\app\models\insightface\models\antelopev2\genderage.onnx2024-11-16T19:34:05.205476 -  2024-11-16T19:34:05.205476 - genderage2024-11-16T19:34:05.205476 -  2024-11-16T19:34:05.205476 - ['None', 3, 96, 96]2024-11-16T19:34:05.205476 -  2024-11-16T19:34:05.205476 - 0.02024-11-16T19:34:05.205476 -  2024-11-16T19:34:05.205476 - 1.02024-11-16T19:34:05.205476 - 
2024-11-16T19:34:05.734960 - Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}2024-11-16T19:34:05.735961 - 
2024-11-16T19:34:05.907117 - find model:2024-11-16T19:34:05.907117 -  2024-11-16T19:34:05.908118 - E:\pinokio\api\comfy.git\app\models\insightface\models\antelopev2\glintr100.onnx2024-11-16T19:34:05.908118 -  2024-11-16T19:34:05.909119 - recognition2024-11-16T19:34:05.909119 -  2024-11-16T19:34:05.909119 - ['None', 3, 112, 112]2024-11-16T19:34:05.909119 -  2024-11-16T19:34:05.909119 - 127.52024-11-16T19:34:05.910119 -  2024-11-16T19:34:05.910119 - 127.52024-11-16T19:34:05.910119 - 
2024-11-16T19:34:06.011305 - Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}2024-11-16T19:34:06.011305 - 
2024-11-16T19:34:06.012296 - find model:2024-11-16T19:34:06.012296 -  2024-11-16T19:34:06.012296 - E:\pinokio\api\comfy.git\app\models\insightface\models\antelopev2\scrfd_10g_bnkps.onnx2024-11-16T19:34:06.012296 -  2024-11-16T19:34:06.012296 - detection2024-11-16T19:34:06.012296 -  2024-11-16T19:34:06.012296 - [1, 3, '?', '?']2024-11-16T19:34:06.012296 -  2024-11-16T19:34:06.012296 - 127.52024-11-16T19:34:06.012296 -  2024-11-16T19:34:06.012296 - 128.02024-11-16T19:34:06.013306 - 
2024-11-16T19:34:06.013415 - set det-size:2024-11-16T19:34:06.013415 -  2024-11-16T19:34:06.013415 - (640, 640)2024-11-16T19:34:06.013415 - 
2024-11-16T19:34:06.013415 - Loaded EVA02-CLIP-L-14-336 model config.
2024-11-16T19:34:06.025428 - Shape of rope freq: torch.Size([576, 64])
2024-11-16T19:34:11.267012 - Loading pretrained EVA02-CLIP-L-14-336 weights (eva_clip).
2024-11-16T19:34:11.959287 - incompatible_keys.missing_keys: ['visual.rope.freqs_cos', 'visual.rope.freqs_sin', 'visual.blocks.0.attn.rope.freqs_cos', 'visual.blocks.0.attn.rope.freqs_sin', 'visual.blocks.1.attn.rope.freqs_cos', 'visual.blocks.1.attn.rope.freqs_sin', 'visual.blocks.2.attn.rope.freqs_cos', 'visual.blocks.2.attn.rope.freqs_sin', 'visual.blocks.3.attn.rope.freqs_cos', 'visual.blocks.3.attn.rope.freqs_sin', 'visual.blocks.4.attn.rope.freqs_cos', 'visual.blocks.4.attn.rope.freqs_sin', 'visual.blocks.5.attn.rope.freqs_cos', 'visual.blocks.5.attn.rope.freqs_sin', 'visual.blocks.6.attn.rope.freqs_cos', 'visual.blocks.6.attn.rope.freqs_sin', 'visual.blocks.7.attn.rope.freqs_cos', 'visual.blocks.7.attn.rope.freqs_sin', 'visual.blocks.8.attn.rope.freqs_cos', 'visual.blocks.8.attn.rope.freqs_sin', 'visual.blocks.9.attn.rope.freqs_cos', 'visual.blocks.9.attn.rope.freqs_sin', 'visual.blocks.10.attn.rope.freqs_cos', 'visual.blocks.10.attn.rope.freqs_sin', 'visual.blocks.11.attn.rope.freqs_cos', 'visual.blocks.11.attn.rope.freqs_sin', 'visual.blocks.12.attn.rope.freqs_cos', 'visual.blocks.12.attn.rope.freqs_sin', 'visual.blocks.13.attn.rope.freqs_cos', 'visual.blocks.13.attn.rope.freqs_sin', 'visual.blocks.14.attn.rope.freqs_cos', 'visual.blocks.14.attn.rope.freqs_sin', 'visual.blocks.15.attn.rope.freqs_cos', 'visual.blocks.15.attn.rope.freqs_sin', 'visual.blocks.16.attn.rope.freqs_cos', 'visual.blocks.16.attn.rope.freqs_sin', 'visual.blocks.17.attn.rope.freqs_cos', 'visual.blocks.17.attn.rope.freqs_sin', 'visual.blocks.18.attn.rope.freqs_cos', 'visual.blocks.18.attn.rope.freqs_sin', 'visual.blocks.19.attn.rope.freqs_cos', 'visual.blocks.19.attn.rope.freqs_sin', 'visual.blocks.20.attn.rope.freqs_cos', 'visual.blocks.20.attn.rope.freqs_sin', 'visual.blocks.21.attn.rope.freqs_cos', 'visual.blocks.21.attn.rope.freqs_sin', 'visual.blocks.22.attn.rope.freqs_cos', 'visual.blocks.22.attn.rope.freqs_sin', 'visual.blocks.23.attn.rope.freqs_cos', 'visual.blocks.23.attn.rope.freqs_sin']
2024-11-16T19:34:17.883965 - �[33mINFO: Clip Vision model loaded from E:\pinokio\api\comfy.git\app\models\clip_vision\CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors�[0m2024-11-16T19:34:17.884966 - 
2024-11-16T19:34:17.896596 - �[33mINFO: IPAdapter model loaded from E:\pinokio\api\comfy.git\app\models\ipadapter\ip-adapter-plus_sdxl_vit-h.safetensors�[0m2024-11-16T19:34:17.896596 - 
2024-11-16T19:34:18.149828 - �[33mINFO: the IPAdapter reference image is not a square, CLIPImageProcessor will resize and crop it at the center. If the main focus of the picture is not in the middle the result might not be what you are expecting.�[0m2024-11-16T19:34:18.149828 - 
2024-11-16T19:34:18.150829 - Requested to load CLIPVisionModelProjection
2024-11-16T19:34:18.150829 - Loading 1 new model
2024-11-16T19:34:18.670913 - loaded completely 0.0 1208.09814453125 True
2024-11-16T19:34:21.451054 - Requested to load SDXL
2024-11-16T19:34:21.451293 - Loading 1 new model
2024-11-16T19:34:23.521561 - loaded completely 0.0 4897.0483474731445 True
2024-11-16T19:34:27.759755 - 
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:04<00:00,  2.27it/s]2024-11-16T19:34:27.760755 - 
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:04<00:00,  1.93it/s]2024-11-16T19:34:27.760755 - 
2024-11-16T19:34:27.761756 - Requested to load AutoencoderKL
2024-11-16T19:34:27.761756 - Loading 1 new model
2024-11-16T19:34:27.884868 - loaded completely 0.0 159.55708122253418 True
2024-11-16T19:34:31.084305 - �[96mFace Analysis: value: 0.04220995923386117, normalized: 0.6029994176265882�[0m2024-11-16T19:34:31.084305 - 
2024-11-16T19:34:32.295010 - �[33mINFO: Clip Vision model loaded from E:\pinokio\api\comfy.git\app\models\clip_vision\CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors�[0m2024-11-16T19:34:32.295010 - 
2024-11-16T19:34:32.307021 - �[33mINFO: IPAdapter model loaded from E:\pinokio\api\comfy.git\app\models\ipadapter\ip-adapter-plus-face_sdxl_vit-h.safetensors�[0m2024-11-16T19:34:32.307021 - 
2024-11-16T19:34:32.543237 - Requested to load CLIPVisionModelProjection
2024-11-16T19:34:32.544238 - Loading 1 new model
2024-11-16T19:34:32.818497 - loaded completely 0.0 1208.09814453125 True
2024-11-16T19:34:35.475354 - Requested to load SDXL
2024-11-16T19:34:35.476356 - Loading 1 new model
2024-11-16T19:34:39.963288 - 
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:04<00:00,  2.14it/s]2024-11-16T19:34:39.963288 - 
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:04<00:00,  1.79it/s]2024-11-16T19:34:39.963288 - 
2024-11-16T19:34:40.426331 - !!! Exception during processing !!! Input image size (352*352) doesn't match model (224*224).
2024-11-16T19:34:40.429334 - Traceback (most recent call last):
  File "E:\pinokio\api\comfy.git\app\execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "E:\pinokio\api\comfy.git\app\execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "E:\pinokio\api\comfy.git\app\execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)
  File "E:\pinokio\api\comfy.git\app\execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "E:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_essentials\segmentation.py", line 51, in execute
    out = model(**inputs)
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\transformers\models\clipseg\modeling_clipseg.py", line 1436, in forward
    vision_outputs = self.clip.vision_model(
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\transformers\models\clipseg\modeling_clipseg.py", line 870, in forward
    hidden_states = self.embeddings(pixel_values, interpolate_pos_encoding=interpolate_pos_encoding)
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
  File "E:\pinokio\api\comfy.git\app\env\lib\site-packages\transformers\models\clipseg\modeling_clipseg.py", line 211, in forward
    raise ValueError(
ValueError: Input image size (352*352) doesn't match model (224*224).

2024-11-16T19:34:40.433338 - Prompt executed in 43.36 seconds

Attached Workflow

Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

Workflow too large. Please manually upload the workflow from local file system.

Additional Context

(Please add any additional context or steps to reproduce the error here)



### Other

_No response_
@xdew77 xdew77 added the User Support A user needs help with something, probably not a bug. label Nov 16, 2024
@ltdrdata
Copy link
Collaborator

You need to downgrade transformers package.

huggingface/transformers#34415

@xdew77
Copy link
Author

xdew77 commented Nov 17, 2024

I have this error in Pinokio ComfyUI. I understand I need to install (downgrade) transformers==4.45.0. I did that with anaconda and pip install transformers==4.45.0 but in E:\pinokio\api\comfy.git\app or where in which folder should it be installed? I also didn't find any test_modeling_clipseg.py, only a modeling_clipseg.py.

@ltdrdata
Copy link
Collaborator

I have this error in Pinokio ComfyUI. I understand I need to install (downgrade) transformers==4.45.0. I did that with anaconda and pip install transformers==4.45.0 but in E:\pinokio\api\comfy.git\app or where in which folder should it be installed? I also didn't find any test_modeling_clipseg.py, only a modeling_clipseg.py.

You need to downgrade the package in the Python environment where ComfyUI is running.

For the correct method to downgrade the pip package in the Pinokio environment, it would be best to consult Pinokio's repository.

As long as the transformers package is downgraded, there's no need to worry about other parts.

@xdew77
Copy link
Author

xdew77 commented Nov 18, 2024

comfyUI in pinokio updates always transformers to the latest version 4.46.2
how can I prevent that?
i do install:
(env) (base) E:\pinokio\api\comfy.git\app\env\Scripts>python -s -m pip install transformers==4.45.0
I get my sitepackages E:\pinokio\api\comfy.git\app\env\Lib\site-packages "transformers" and "transformers-4.45.0.dist-info" but after starting comfyUI I see it downloads to the latest transformers 4.46.2

I need transformers 4.45.0 for "Apply Clipseg+" to work
please help, thanks!

@ltdrdata
Copy link
Collaborator

comfyUI in pinokio updates always transformers to the latest version 4.46.2 how can I prevent that? i do install: (env) (base) E:\pinokio\api\comfy.git\app\env\Scripts>python -s -m pip install transformers==4.45.0 I get my sitepackages E:\pinokio\api\comfy.git\app\env\Lib\site-packages "transformers" and "transformers-4.45.0.dist-info" but after starting comfyUI I see it downloads to the latest transformers 4.46.2

I need transformers 4.45.0 for "Apply Clipseg+" to work please help, thanks!

ComfyUI cannot independently resolve actions that occur within Pinokio.

@merket
Copy link

merket commented Nov 20, 2024

comfyUI in pinokio updates always transformers to the latest version 4.46.2 how can I prevent that? i do install: (env) (base) E:\pinokio\api\comfy.git\app\env\Scripts>python -s -m pip install transformers==4.45.0 I get my sitepackages E:\pinokio\api\comfy.git\app\env\Lib\site-packages "transformers" and "transformers-4.45.0.dist-info" but after starting comfyUI I see it downloads to the latest transformers 4.46.2

I need transformers 4.45.0 for "Apply Clipseg+" to work please help, thanks!

Go into the folder Pinokio\api\comfy.git\app ... Shift right click on the folder window. Choose "Run Powershell from here" once the shell opens type "env\Scripts\activate" you should now see a green (env) .
Now type "pip install transformers==4.45.0" it should uninstall whatever version there is then install 4.45
Good luck.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
User Support A user needs help with something, probably not a bug.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@merket @ltdrdata @xdew77