Can not generate full body with face lora model.

I train a lora model by flux using some face images. I find that is norml when generating face or half body of the person. When generating a full-body person, the face of lora model changes. How to solve this?