Is there a way to randomize and/or specify the seed in LLM?

[anastasiuspernat]

Usually in all models there's a way to specify the seed value for reproducibility. In addition I noticed that LLM/Llama model subsequent calls produce very similar results. So it would be really really cool to have an option to specify the seed, or at least a switch to randomize it on every call. Thank you!

[heshengtao]

In general, increasing the temperature can increase the richness. You can try using the extra parameters node to set more parameters for the LLM.Both top k and top p affect the randomness of LLM.