#270·gpt-neo

The temperature at 0.0001 (or other arbitrarily small float) is still too high

Author: monsieurpoohCreated Jan 22, 2022Updated Feb 23, 2022
Labelsbug

If setting the temperature to 0.00001 or similarly low float, the output is noticeably less chaotic than when temperature is a significantly larger numbers; however, the output is still very non-deterministic and often answers questions wrong even when the majority of the time it may have gotten it right. I suspect it would be better to have more freedom over the temperature range, where 0.00001 actually denotes extremely low temperature with almost no variation in output, for better question-answering capability

If anyone knows of a workaround to this please let me know