Question about the <unk> in the subsample function of chapter_natural-language-processing-pretraining
Author: IMMORTAALLLCreated Sep 30, 2025Updated Jan 29, 2026
Why is it that in the subsample function of this section, the token is discarded when calculating the word count, but is not added to sentences later? It may do harm to the ability of model to learn the rear token.
Source: d2l-ai/d2l-en