Question about optimal hyper parameters for training Qwen-Image-Edit-2509

DiffSynth is great. I am trying to train Qwen-Image-Edit-2509. I have a dataset of 5.4k examples. I'm curious if full parameter fine-tuning could be feasible with this dataset size, and if so at what hyperparameters? I've tried 1e-5 and 5e-6 at a 128 effective batch size and the model degrades when I evaluate it.

The next thing I'll try is LoRA, but I'm just confused how I couldn't get the training to have any positive impact on the model at any point across a variety of training runs. Curious if anyone, besides the Qwen team, knows how to successfully fine-tune this model. Thanks!