Add voice dictation to Assistant using Whisper

Thibaultmol

Something i'm missing from chatgpt is the ability to dictate my texts.
This is useful on desktop obv but also on mobile (where you're limited by your keyboards voice dictation (if it even has it). And gboard voice dictation always has been reallyl bad compared to Whisper.

Whisper is open source so you def don't have to use openai's api for it. You can probably find a lot of cheaper places

a mic button on the page that starts and stops an audio transcription. ideally in realtime but it would be fine if it's not

Thibaultmol

also note: make it a setting to let us choose which version of whisper we would want to use: it should be on the normal size of whisper by default. But people who want to ask questions in other langauges OR speak english with a heavy accent should be able to choose a larger version of whisper so it'll be more accurate

Thibaultmol

and hey: maybe it's worth using webassembly to run whisper locally in the browser if you can detect somehow that the pc is powerful enough? (from my experience gpu isn't even required, whisper on cpu is pretty fast already)
https://github.com/xenova/whisper-web
this wouldn' apply to smartphones obv, but a lot of desktop and laptop users probably could just have it run in the browser