Mind you, it is 1.0 by default, yet everyone is focused on how much the new model thinks, restricting the reasoning budget and/or dropping the reasoning level. Set the temperature to 0.7 and the model will no longer write a whole book of thoughts before trying to make a small edit in the file. The question is - how much does this affect the model's capabilities? What is the sweet spot for the temp parameter for various tasks? submitted by /u/bSun0000 [link] [comments]
Read original ↗ Content from Reddit r/LocalLLaMA（Community）