TypeError: The current model class (MiniMindForCausalLM) is not compatible with `.generate()`, as it doesn't have a language model head.

Is your feature request related to a problem? Please describe.

Traceback (most recent call last): File "/home/ansible/online/operator/autovision-notebook-cfs/code_base/minimind/eval_model.py", line 202, in main() File "/home/ansible/online/operator/autovision-notebook-cfs/code_base/minimind/eval_model.py", line 182, in main generated_ids = model.generate( File "/usr/local/lib/python3.10/dist-packages/torch/utils/_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/transformers/generation/utils.py", line 1408, in generate self._validate_model_class() File "/usr/local/lib/python3.10/dist-packages/transformers/generation/utils.py", line 1203, in _validate_model_class raise TypeError(exception_message) TypeError: The current model class (MiniMindForCausalLM) is not compatible with .generate(), as it doesn't have a language model head. 采用自己的编码器最终推理的时候报这个错，我看模型结构中是有lm_head的不知道为啥

Solutions

Traceback (most recent call last): File "/home/ansible/online/operator/autovision-notebook-cfs/code_base/minimind/eval_model.py", line 202, in main() File "/home/ansible/online/operator/autovision-notebook-cfs/code_base/minimind/eval_model.py", line 182, in main generated_ids = model.generate( File "/usr/local/lib/python3.10/dist-packages/torch/utils/_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/transformers/generation/utils.py", line 1408, in generate self._validate_model_class() File "/usr/local/lib/python3.10/dist-packages/transformers/generation/utils.py", line 1203, in _validate_model_class raise TypeError(exception_message) TypeError: The current model class (MiniMindForCausalLM) is not compatible with .generate(), as it doesn't have a language model head. 采用自己的编码器最终推理的时候报这个错，我看模型结构中是有lm_head的不知道为啥

Additional context

No response