Show LLM usage in Assistant

bkrein

I’ve been hitting the Assistant fair use limitation quite regularly over the last couple of months. I think it’d be great if you can show a counter of some sort of how much I have left available at all times at the top of the assistant. I’d also like to know how much each thread is costing as I work on it, so I can decide easier if it’s worth switching models, or start a new thread.

I’d love for this to be prioritized because it’s quite annoying to fit the limit when I have only a few dollars left.

Thanks!

A small counter or number at the top bar of the assistant showing how much usage is current thread having, and total amount left next to it.

bkrein

Would love this to be prioritized. As an ultimate subscriber I’d expect basic things like this issue that make my experience worse to be prioritized and fixed.

Luis

Hey @bkrein, apologies for the delayed response.

We currently have notifications to alert you when you approach 80% of your usage limit. But I understand from your feedback that this approach isn't sufficient?

Based on your suggestion, we're considering to add token and cost statistics directly within the thread menu.

Also, we will soon change how overages are handled. We are moving from an early renewal system to pay-as-you-go. You will be able to opt into this feature for your account; if you then exceed your limit in a given month, you will simply be invoiced for the additional usage.

Would these 2 changes solve your problems?

bkrein

Sorry for the late reply on this. But yeah, adding stats in the thread menu would be very useful. Basically I'd like the usage limit always showing somewhere (not just when I hit 80%).

And sounds good with a pay-as-you-go, but currently there's no renewal yet right? Or at least now I just get "You cannot renew your plan at this current time".