Hello everyone. I am Dr. Furkan Gözükara. PhD Computer Engineer. SECourses is a dedicated YouTube channel for the following topics : Tech, AI, News, Science, Robotics, Singularity, ComfyUI, SwarmUI, ML, Artificial Intelligence, Humanoid Robots, Wan 2.2, FLUX, Krea, Qwen Image, VLMs, Stable Diffusion
i was told that supir would work if i had enough system ram, so i upgraded to 64 and comfyui is still saying out of memory, do i need to run comfy in low vram mode?
I am wondering if this technique could be used to upscale images by having high res reference photos https://realfill.github.io/ Like having an old image in front of a church but the church still looks the same, so you give it a today taken photo as reference to enhance the photo. Or you want to colorize an photo of the original Titanic, so you give it photos of the movie Titanic where they restored it by hand
Have you read the paper? It's about training the AI on reference pictures from a simular scene with at least one image as training image to expand or inpaint an target image for a accurate representation.
Stable Diffusion plugins just recreate the images or inpaint randomly by it's text input. But RealFill uses actual reference images that are accurate to the target image, hence why it's called RealFill. Like in my mentioned examples above, this could be very useful for restoration.
wdym? That's the best case scenario you could have when you are allowed to give the AI the information to make an accurate restoration of an image or video or what ever instead of letting the AI think what it sees.
I see facefusion has a new update, however im getting an error - RuntimeError: D:\a_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:743 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasn't able to be loaded. Please install the correct version of CUDA and cuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported.
I would like to ask for some help. Have you known a comfyui AI that can create json files based on a prompt (or/and pic or/and video) that can be dropped into comfyUI? If not, how would it be worthwhile to start making one?