Any way to load transformers.CsmForConditionalGeneration weights into csm.Model

If I use the HF transformer API (https://huggingface.co/sesame/csm-1b#fine-tuning--training-%F0%9F%93%89) to finetune the csm-1b model. After I saved the weights of model type transformers.CsmForConditionalGeneration, how can I load the trained model weights back into csm.Model, as defined here in this repo? I'm looking for a simple interface or API to achieve this. Thanks!