Assistant Doesn't Seem to Read Whole File Attachment?

iamjameswalters

I uploaded a CSV of phone numbers, and pasted in the content of an email with an updated list of numbers, and asked Assistant (tried with ChatGPT 4o and Claude 3.7 Sonnet) to list which numbers from the email were not present in the CSV, and it tells me that numbers are missing from the CSV when they're there. Telling it, "You're wrong, that number's there" will cause it to apologize and correct its mistake.

My data's good, and doing the same query at claude.ai worked as expected.

Assistant doesn't seem to be reading the entire file--any reason why this would be so?

iamjameswalters

Had a similar case today--asked Claude to extract and boil down some information from a word document.

Kagi Assistant using Claude provided the following for one category:

Claude at claude.ai provided this, including two notice categories that Kagi Assistant overlooked.

Again, I can tell it it's wrong, and it will attempt to correct itself (but in this case, still gets it wrong).

I can only assume there's something going on either with limiting the initial context provided through file attachments, or with Assistant's system prompt. Or perhaps something is happening to how the file is parsed before handing it over to Claude?

Any chance we can look into this behavior?