✨ Is possibale to use the ChatGPT of OpenAI to train this ChatGPT?
Author: Yonv1943Created Feb 2, 2023Updated Nov 5, 2023
OpenAI used 40 people when training their own chatGPT, and the annotation process lasted for 3 months.
It is difficult for our open source community （github） to reproduce the Reinforcement Learning by Human Feedback (RLHF) for this work, as OpenAI also employs 40 people to complete human feedback.
However, we can treat OpenAI's web version of chatGPT as human, who can annotate data ✨ for us when training our own chatGPT.
Step 2, A labeler (human or OpenAI chatGPT) ranks the outputs from best to worst.
This sounds a bit funny, but I currently think it's doable. @lucidrains
Source: lucidrains/PaLM-rlhf-pytorch