No Retention of system prompt post the context window

Due diligence

• I have done my due diligence in trying to find the answer myself.

Topic

The PyTorch implementation

Question

Moshi has a RingKVCache, the context rotates to a fresh window after reaching 3000 frames. This means that personaplex does not retain the prompt instructions post the 3000 frame window.

Is Personaplex trained on only conversation intros ? (since only those would have the system prompt), or is personaplex meant to infer the flow from just recent conversation context.