Classifier free guidance for prior model

Author: macrohuang1993Created Apr 6, 2023Updated Jan 19, 2024

Hello everyone, For the "DiffusionPriorNetwork" "forward_with_cond_scale" method: null_logits = self.forward(*args, text_cond_drop_prob = 1., image_cond_drop_prob = 1, **kwargs)

Could someone explain why we also drop the image_embed via image_cond_drop_prob? I think "image_embed" should be kept even in the unconditional generation since that is the noisy CLIP image embedding, and the classifier free guidance should only drop the text_condition part for calculating null_logits.

Thanks!

Source: lucidrains/DALLE2-pytorch