Software Engineering Courses (SECourses)•2y ago

<@205854764540362752> Ok, this error after installation 1024_8bit "Some modules are dispatched on th

@Furkan Gözükara SECourses Ok, this error after installation 1024_8bit "Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model on the CPU or the disk while keeping these modules in 32-bit, you need to set

load_in_8bit_fp32_cpu_offload=True

load_in_8bit_fp32_cpu_offload=True

and pass a custom

device_map

device_map

from_pretrained

from_pretrained

" means that i should use lowvram version (i have 6gb vram)?

Jjoosheen <@205854764540362752> Ok, this error after installation 1024_8bit "Some modules ...

Furkan Gözükara SECourses•1/16/24, 10:05 PM

ye give it a try but 6gb really low

joosheenOP•1/16/24, 10:06 PM

yes, i know :/ i should think about sth with more vram

mikemenders•1/18/24, 8:33 PM

I have AudioCraft Plus. How can I generate music with a beginning ("intro") and an end?

Mmikemenders I have AudioCraft Plus. How can I generate music with a beginning ("intro") and ...

Furkan Gözükara SECourses•1/18/24, 9:55 PM

good question

Furkan Gözükara SECourses•1/18/24, 9:55 PM

sadly i dont know if that possible

Furkan Gözükara SECourses•1/18/24, 9:55 PM

it has input audio but not input and ending as far as i know

mikemenders•1/19/24, 6:04 AM

Because the Stable Audio sample has a beginning and an end, and I've also generated music in Wondershare Filmora and it's been solved there, so I'm wondering which other music generators are suitable for that, and I'd like to run it on my home computer.

Deleted User•1/19/24, 2:37 PM

https://www.youtube.com/watch?v=0V29mepfqBY

YouTubeFull-stack Dev Mastery

How to create a fullstack application with ChatGPT

Learn how to build a full application with ChatGPT

#ai #chatgpt #backend #frontend #fullstack #webdesign #webdev #webdevelopment #html #css #js #javascript #react #angular #react #reactjs #artificialintelligence #chatgpt4

thawadioo•1/19/24, 11:06 PM

thawadioo•1/19/24, 11:15 PM

7950x3d+4090+64gb ddr5 .. for SDXL i use your config dreambooth 24GB_NoTextEncoder , with 60 Training images my face 40 repeats ,your Regularisation images 1024x1024_2734_imgs 1 Repeats .....9 hours of training and good result of high quality , kohya-ss v22.4.1 without any error messages

thawadioo•1/19/24, 11:20 PM

1.5 Based Models Training Config me_sd_7e7_v2.json same 60 Training images of my face 768x768 ,40 repeats and Regularisation images man_5200_imgs_768x768 1 Repeats = 5 hours of bad result getting all same picture

thawadioo•1/19/24, 11:21 PM

what im doing wrong ?

Tthawadioo 7950x3d+4090+64gb ddr5 .. for SDXL i use your config dreambooth 24GB_NoTextEncod...

Furkan Gözükara SECourses•1/19/24, 11:46 PM

60 train 40 repeat

Furkan Gözükara SECourses•1/19/24, 11:46 PM

how many epochs?

Furkan Gözükara SECourses•1/19/24, 11:46 PM

it makes 4800 steps with reg images

Furkan Gözükara SECourses•1/19/24, 11:46 PM

if 1 epoch

thawadioo•1/19/24, 11:47 PM

8 , i didnt change anything just put the images folders

Tthawadioo 8 , i didnt change anything just put the images folders

Furkan Gözükara SECourses•1/19/24, 11:47 PM

ok 8 is too many

Furkan Gözükara SECourses•1/19/24, 11:47 PM

what is your speed how many second / it

thawadioo•1/19/24, 11:47 PM

1.25

Furkan Gözükara SECourses•1/19/24, 11:47 PM

that is normal speed

Furkan Gözükara SECourses•1/19/24, 11:47 PM

so you need to reduce number of epochs

Furkan Gözükara SECourses•1/19/24, 11:47 PM

i suggest this

Furkan Gözükara SECourses•1/19/24, 11:47 PM

100 repeat

Furkan Gözükara SECourses•1/19/24, 11:47 PM

1 epoch

Furkan Gözükara SECourses•1/19/24, 11:47 PM

and save checkpoints

Furkan Gözükara SECourses•1/19/24, 11:48 PM

100 * 60 *2 = 12000 steps

Furkan Gözükara SECourses•1/19/24, 11:48 PM

so save every 1201 steps

Furkan Gözükara SECourses•1/19/24, 11:48 PM

to see which one will perform best

thawadioo•1/19/24, 11:48 PM

OK thank you i will test it

thawadioo•1/20/24, 12:16 AM

train unet: True, text_encoder1: False, text_encoder2: False
number of models: 1
number of trainable parameters: 2567463684
prepare optimizer, data loader etc.
use Adafactor optimizer | {'scale_parameter': False, 'relative_step': False, 'warmup_init': False, 'weight_decay': 0.01}
constant_with_warmup will be good / スケジューラはconstant_with_warmupが良いかもしれません
enable full bf16 training.
running training / 学習開始
num examples / サンプル数: 6000
num batches per epoch / 1epochのバッチ数: 12000
num epochs / epoch数: 1
batch size per device / バッチサイズ: 1
gradient accumulation steps / 勾配を合計するステップ数 = 1
total optimization steps / 学習ステップ数: 12000
steps: 0%| | 0/12000 [00:00<?, ?it/s]
epoch 1/1
steps: 3%|█▊ | 416/12000 [07:49<3:38:06, 1.13s/it, avr_loss=0.105]

thawadioo•1/20/24, 12:19 AM

100% gpu utilization ,dedicated gpu memory 17.2/24.0 GB , 20.6 gb ram in use

thawadioo•1/20/24, 12:28 AM

i turn off Gradient checkpointing ,

thawadioo•1/20/24, 12:28 AM

steps: 0%| | 20/12000 [06:13<62:08:29, 18.67s/it, avr_loss=0.129]

Tthawadioo i turn off Gradient checkpointing ,

Furkan Gözükara SECourses•1/20/24, 12:38 PM

it starts using shared VRAM

Furkan Gözükara SECourses•1/20/24, 12:38 PM

therefore it will become too slow

Furkan Gözükara SECourses•1/20/24, 12:39 PM

OneTrainer is fitting into 24 GB so it brings speed up there

Dazzastrous [4090]•1/21/24, 12:35 PM

https://github.com/chaojie/ComfyUI-Moore-AnimateAnyone

GitHub

GitHub - chaojie/ComfyUI-Moore-AnimateAnyone

Contribute to chaojie/ComfyUI-Moore-AnimateAnyone development by creating an account on GitHub.

DDazzastrous [4090]https://github.com/chaojie/ComfyUI-Moore-AnimateAnyone

Furkan Gözükara SECourses•1/21/24, 5:36 PM

thanks

bert•1/21/24, 5:37 PM

I want to create a space on my mac where i can install and run packages and experiment around but I should be able to delete this space/folder and after that none of what i did or installed during my experimentation should remain on my pc. how can I do this?