Hi,
I would like to report a recurring issue with Kagi Assistant, which might be related to another thread I started yesterday (link below in the text).
For some time now, I've noticed that Kagi Assistant is generating more and more incorrect answers when searching for information online, even though the correct sources are attached as web pages.
Example:
https://kagi.com/assistant/a6099341-d55d-48a1-92bf-cf5bd8c9b6c7
As a test, I asked Kagi Assistant which AI models are available in Perplexity Max. The Assistant found good sources, and one of the main sources is a page where all the models are listed, so the answer is essentially provided directly. However, the Assistant gave an incorrect answer.
When I pointed out this specific source to the assistant and asked why it didn't provide information from it, it admitted that it had only received a short snippet from that page, not the full content. As a result, it constructed an answer from what it got—ultimately, the answer was wrong.
I noticed a very similar pattern when uploading files for analysis, which I described in the thread:
https://kagifeedback.org/d/10290-degradation-of-file-analysis-functionality-in-kagi-assistant/2
(The assistant either claims it couldn't find specific information in the file, or it pulls only partial data and fills in the rest with hallucinations.)
I've spent a lot of time since yesterday testing and searching for similar threads on this forum to figure out what the problem might be. I didn't see these kinds of issues until recently.
I have a hypothesis that there might be an issue with the component responsible for searching/analyzing the provided sources and extracting the relevant fragments, which are then passed on to the target AI model.
It looks like something has changed in this area, causing fragments that are too small or incorrect to be sent to the target AI models. As a result, incorrect or erroneous responses are being generated—both for web sources and attached files.
I would be very grateful if someone could look into this matter and verify the problem.
Thanks!
