Virtual Background - Add temporal smoothing to reduce segmentation flicker
Author: solomon17705csCreated Mar 4, 2026Updated Sep 2, 2026
Labelsfeature-request
What problem are you trying to solve?
The virtual background processes each video frame independently, without referencing previous frames. This lack of temporal consistency causes visible artifacts during motion:
- Jitter: When raising a hand or moving quickly, the segmentation mask fluctuates frame-to-frame, creating a "ghostly" or "shimmering" effects
- Flicker on Small Movements: Subtle movements cause the mask to alternately classify pixels as foreground/background, resulting in a strobing effect where the user and background appear to toggle rapidly.
The segmentation model outputs a per-frame alpha mask with no temporal smoothing. Small variations in inference (body movements, due to lighting, or model uncertainty) manifest as visible jitter when composited.
What solution would you like to see?
Implementation of lightweight temporal smoothing by blending the current frame's alpha mask with the previous frame's mask would reduce the flickering
Is there an alternative?
No response
Source: jitsi/jitsi-meet