Allow upload to more than assistant

stoyle

I uploaded a csv file to assistant/claude, and it was terrible at interpreting it. Would be nice to be able to check the other models as well.

Allowing upload in the other selections, e.g. chat variants would be very nice. Maybe gpt4 would’ve handled it better.

I was in fact tempted to re-subscribe to open ai to test.

Vlad

stoyle Any ideas about how do we go about limits? Uploading a large file to gpt-4 and having a chat could cost $5-10 just for that one file.

Value7609

Vlad maybe you could implement a token limit? So if someone uploads a file, you first check how many tokens that would be, and if it is smaller than your token limit, it would be okay, otherwise you could ask if it's okay to first summarize the file with one of your models and then pass it to the LLM.

stoyle

Oh wow, I was not aware. If it is such a huge cost, I guess not allowing it is simplest.

This file was less than a MB, and I tried pasting it directly. But at that time the prompt size was limited, it may have worked today though. What does open ai/chatgpt allow? And what is the cost say for a 1MB file?

Vlad

1MB of text is roughly 250000 tokens.

price for gpt-4-32k is $0.06 / 1K tokens

so roughly it would cost about $15.

https://openai.com/pricing

Grooty

Vlad What about a file size limit of like 50-100 KB?

stoyle

In that case, with the current subscription model this probably doesn’t make sense.

If somehow a user could “pay as you go” for something like it, it could be viable, I guess. But I am assuming that is far from your current plans.

mackid1993

It would be great to be able to upload a document and parse it with any model available, not just in research mode. This is another ability that brought me back to ChatGPT along with the limited input and output.

Enabling something like this at least in models where it is supported will be super helpful as different modes excel in different areas.