4090 上的 49 秒/次

Getting EXTREMELY slow training speed. 49 sec/it on 4090 seems completely unreasonable. Here's my config: 14:16:06-593487 WARNING Here is the trainer command as a reference. It will not be executed: 14:16:06-594489 INFO C:\StableDiffusion\kohya_ss\venv\Scripts\accelerate.EXE launch --dynamo_backend no --dynamo_mode default --mixed_precision fp16 --num_processes 1 --num_machines 1 --num_cpu_threads_per_process 2 C:/StableDiffusion/kohya_ss/sd-scripts/sdxl_train_network.py --config_file C:/StableDiffusion/kohya_ss/dataset/formatted_training_images\model/config_lora-20240521-141606.toml 14:16:06-595487 INFO Showing toml config file: C:/StableDiffusion/kohya_ss/dataset/formatted_training_images\model/config_lora-20240521-141606.toml 14:16:06-596487 INFO bucket_no_upscale = true bucket_reso_steps = 64 caption_extension = ".txt" clip_skip = 1 dynamo_backend = "no" enable_bucket = true epoch = 10 gradient_accumulation_steps = 1 huber_c = 0.1 huber_schedule = "snr" learning_rate = 0.0001 logging_dir = "C:/StableDiffusion/kohya_ss/dataset/formatted_training_images\\log" loss_type = "l2" lr_scheduler = "cosine_with_restarts" lr_scheduler_args = [] lr_scheduler_num_cycles = 3 lr_scheduler_power = 1 lr_warmup_steps = 388 max_bucket_reso = 2048 max_data_loader_n_workers = 0 max_grad_norm = 1 max_timestep = 1000 max_token_length = 75 max_train_steps = 7770 min_bucket_reso = 256 mixed_precision = "fp16" multires_noise_discount = 0.3 network_alpha = 16 network_args = [] network_dim = 32 network_module = "networks.lora" no_half_vae = true noise_offset_type = "Original" optimizer_args = [ "weight_decay=0.1", "betas=[0.9,0.99]",] optimizer_type = "AdamW8bit" output_dir = "C:/StableDiffusion/kohya_ss/dataset/formatted_training_images\\model" output_name = "last" pretrained_model_name_or_path = "stabilityai/stable-diffusion-xl-base-1.0" …