Question about dataprocess of SeeKeR
Author: ahxchztCreated Oct 24, 2023Updated Oct 26, 2023
I'd like to know how you handle data, as you have three different tasks (search query, knowledge, response). During the training process, do you mix these three different types of data together for training, or do you train one task after another once a task is completed? If it's the latter, I'm curious about how you address the issue of catastrophic forgetting.
Source: facebookresearch/ParlAI