Add creativity customization to Assistant models

httpjames

In Direct chat mode in Assistant, it would be helpful to be able to change the amount of "creativity" the model has. "Creativity" would be an abstraction for optimal temperatures. For example, "Minimal" or "Deterministic" level would be a temperature of 0.3, "Normal" would be 0.5 or 0.7, "Maximum" would be 1.0 or higher (although in my experience, GPT-4 becomes psychotic above 1.0).

Raycast AI has implemented this using a dropdown with similar naming.

TamsynUlthara

I'm a heavy user of Kagi Assistant; my wife and I both have Ultimate plans because of how indispensable we find it.

The lack of a temperature setting is frustrating when trying to spur creative results; I can run local LLMs only slowly, but being able to tweak temperature (among other settings) to my heart's content is a huge advantage to running local LLMs right now. I'd love to be able to move most of my now-local usage to Kagi Assistant, instead.