out of memory in training with batch size 1

Thank you for your incredible work.

Now, I'm trying to run train code with RTX 3090 (24GB). But, Even with batch size 1, I met out of memory exception, and this is really wierd...

The only difference of my run code with your instruction written in README is batch size. Is it natural results? or Is there any way to reduce required memory?

Thank you