Long Assistant thread unrelatedly referencing old uploaded file

dreifach

An old thread of mine for web building that I continue to use because of its available context has thrown up an issue recently. Research has been randomly and unrelatedly referencing a file uploaded to the thread months ago, and that file had literally no relevance to the queries in question.

Thread ID: 6e4ae166-3b17-5880-a834-1dedb672b7cf

billclinton

The agents will continually, every message I send re-read attached files from previous messages within the current existing chat. This persists across multiple AI models and conversations, I have to explicitly explain to only read once when I send the file to stop it from happening, that usually works but sometimes it will go back and re-read it then remember it wasn't supposed to and "discard" this information. It's an issue because it generally takes a while, especially on a huge log file. It also treats it like "new" information and then sorta complains that I didn't send it a new log, which is true but why read the old file as if it's new information.

Sorry for not having a specific instance or screenshot at this time, I tried to replicate the bug without having my own personal information or logs visible but it was difficult to get it to repeat like that. I do note it has happened more than three times in old logs and I usually just gave up on using that thread and would make a new one with no attachments.

I expected it to remember the file is not a new file each new message with no attachment that I send.

DaleSwanson

I've noticed in several chats, that the assistant will reference an attachment I sent several prompts ago as if I had just sent it with my most recent message.

For example, in my current chat, I attached 1 file, which was read and referenced in the reply to that message. Two messages after that though, the model replied with "But your attachment just changed the picture in an important way, so read the middle section before you go changing anything." In my experience, this will keep happening, with a reference to the attachment in the occasional reply, even if I never attach anything again.

I'd expect the replies to not reference attachments from several messages ago as if they were new.

Here's an example of me directly asking if there is an attachment:

mb

Merging with #11693