Fine-tuning models

Hello! Could you please tell me what resources are needed to fine-tune the pre-trained top level before the new style(s). I want to use model 5b. Is it possible without GPipe?

I run this but with my data:

mpiexec -n {ngpus} python jukebox/train.py --hps=vqvae,prior_1b_lyrics,all_fp16,cpu_ema --name=finetuned \
--sample_length=1048576 --bs=1 --aug_shift --aug_blend --audio_files_dir={audio_files_dir} \
--labels=True --train --test --prior --levels=3 --level=2 --weight_decay=0.01 --save_iters=1000

I set a limit of 30 seconds for my data, but my process is being killed due to lack of RAM. That being said, I'm using the 1b model for now. What else can help reduce the load on my machine's resources? When trying to use the 5b model, an error appears about the lack of cuda memory. How much memory do you need video cards?