The animated model moves even when the subject on camera doesn't

First, amazing job getting this together, very creative! I noticed that even when you're not moving on camera, the pose/face detection seems to create movement where there's none. Is that an issue with the models themselves or in the data that's fed to them?