Replies: 5 comments 13 replies
-
|
Indeed not bad. Which minimal requirements you wanted to discuss? |
Beta Was this translation helpful? Give feedback.
-
|
192x192 is very coherent, 128x128 (doesn't do anything.)
|
Beta Was this translation helpful? Give feedback.
-
|
On my Nvidia 2060 Super with 8GiB of VRAM I got video generation with 24 frames and 320x320 resolution to work at half precision, 360x360 fails with out of memory error. So for that resolution I think this is the minimal requirement. |
Beta Was this translation helpful? Give feedback.
-
|
I have a GPU with 4 gb VRAM, I'll check if it works |
Beta Was this translation helpful? Give feedback.
-
|
Idk why, but that button unloading still leaves a considerable amount of VRAM, which is preventing me from launch the model on your described resolution. Do you have any idea what module it could be?
|
Beta Was this translation helpful? Give feedback.
-
|
EDIT: @kabachuha the latest text2video_pytorch_model is the problem. If you use the text2video_pytorch_model from this commit, you will have no issue. https://huggingface.co/damo-vilab/modelscope-damo-text-to-video-synthesis/tree/7ecc3083c7f3b4214f2dbf61cbf300281f0f7b67 (Remove certain extensions.) I noticed the with aesthetic gradients extension active, the button did not allow me to unload the model completely. I was creating some recently. Running modelscope would continue until it would OOM during vae decode phase.
If I generate with sd, then unload, I see the residual vram as you have, but regardless of that I can still generate at 192 afterwards. I launched webui with a fp32 1.5 .ckpt but the others should work. Generate SD image, then do modelscope After modelscope DRAM |
Beta Was this translation helpful? Give feedback.
-
|
Still not worked even with the previous model. I suspect it might be that the model is not being loaded fully in the memory before doing 'half' on it. I'm pruning the models to fp16 right now and will write if it helped. Pruned weights will be nice to have anyway to save the community's bandwidth https://huggingface.co/kabachuha/modelscope-damo-text2video-pruned-weights Well, now, it at least got past the first stage and broke on diffusion. I guess, some progress 🙂 |
Beta Was this translation helpful? Give feedback.
-
|
I do many consecutive generations, to get a feel for prompts, its consistent for me, just running with no flags on a very fresh installation and 9ef779c, used all your pruned weights. Do you have Hardware Scheduling Disabled? other:
I have the bloated system compared to W10 and linux, so maybe its your gpu having slightly less vram somehow?
What do you mean? it loads the model, then it drops? |
Beta Was this translation helpful? Give feedback.
-
|
I have the just same GeForce RTX 3050 Laptop GPU. Maybe, it's my KDE Linux setup that's breaking the processes to protect my system from overload? 🤔 I'll try running it on Windows |
Beta Was this translation helpful? Give feedback.
-
|
Thank you, works on 970 |
Beta Was this translation helpful? Give feedback.
-
|
Omg |
Beta Was this translation helpful? Give feedback.
-
|
I didn't know github got 10mb limit of video, anyway a quick demo on 970 and 3080 on different resolution and lengths |
Beta Was this translation helpful? Give feedback.
-
|
I can confirm this works with the half-size pruned models on a 1070ti on Ubuntu 22.04 with 8 gigs of vram, in case anyone has a similar card. |
Beta Was this translation helpful? Give feedback.
-
Well, that is not low :) The question was more about the minimal ones, such as only 4 GBs of VRAM |
Beta Was this translation helpful? Give feedback.
-
|
i cant run 192x192 with 4GB vram 1050ti, 128x128 and 128x192 will run but give random/glitch patterns |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
All reactions