#150·LoRA

Layers.py not being executed

Author: Aradhye2002Created Dec 12, 2023Updated Jan 15, 2025

Hi,

I made some changes to the layers.py, however on running the mrpc task on roberta_base, it seems that init() and forward() of the linear layers is not being called at all. I added some print statements inside the forward function to verify this.

In fact, the modeling_roberta.py file is not imported at all which is responsible for importing loralib.

When I ran the model the first time there was some progess bar with "Map" written beside it which was not there in the subsequent runs. Maybe the loralib was read the first time and the model was stored. In all subsequent runs the stored model was run.

Kindly provide guidance.