Clicking "More Results" yields lots of duplicates

NathanKurz

I've noticed lately that when I click on "More Results" at the bottom of a search page, the results that are shown are often duplicates of the ones already given. Maybe I never noticed it before, but I think this might be a relatively recent regression in the last month or so.

As an example, the search I just noticed this on was for [xo noodles] (https://kagi.com/search?q=xo+noodles). When I click "More Results", these are the results that are the same as those that were already given and thus appear twice:

https://www.jamesbeard.org/recipes/noodles-with-xo-pepperoni-sauce
https://www.rachelphipps.com/2023/12/vegan-xo-noodles-with-smoked-tofu.html
https://www.notquitenigella.com/2024/02/14/glass-noodles-vermicelli/
https://www.hwcmagazine.com/recipe/pan-fried-beef-noodles-with-spicy-xo-sauce/
https://www.plateforamate.com/recipes/xo-sauce-instant-noodles/ (twice at botom)
https://www.waiyeehong.com/noodles/instant-noodles-packet/instant-noodles-xo-sauce-seafood-xo (both at bottom)
https://omnivorescookbook.com/xo-noodles-with-shrimp/
https://noobcook.com/xo-sauce-ee-fu-noodles/
https://www.eatyourbooks.com/library/recipes/3117280/xo-noodles-with-shrimp
https://misschinesefood.com/fried-noodles-with-xo-sauce/
https://carryitlikeharry.com/xo-milk-noodles-fried-fish/
https://www.triedandtruerecipe.com/xo-noodles-with-pork/

As a hint to why this might be happening, I noticed that for many of these the date shown is different for the two entries. But not all the dates are different, so maybe this is just chance.

I'd expect results to only appear once. Giving me the same result when I click "More Results" is unhelpful and seems like it has to be a bug.

NathanKurz

Any updates on this? It's been a month and the bug is still there. Are you able to reproduce it? Is there anything else I offer that would help pinpoint the problem?

It seems like it should be a straightforward fix once you find it. As it is, it reduces the utility of the "More results" button so much that it's barely worth using.

In the meantime, I'd appreciate suggestions for temporary workarounds if anyone has them.

NathanKurz

I'm baffled that this bug still exists. I again tried the same example I gave in the report, and it's just as bad. Could I please get an update on this? Almost 6 months ago @RoxyRoxyRoxy said it was planned to be fixed.

This is a straightforward bug that impacts me daily. Why is this still broken? Is it somehow trickier than it looks to dedupe the results list that is returned? What's happening here? Does no one else use the "More results" button?

RoxyRoxyRoxy

NathanKurz Apologies, seems I forgot to update the thread. Unfortunately it is in fact trickier than it looks to dedupe these results 🙂
Mainly this is a result of how we work with results from upstream sources, and deduping is heavily complicated by caching issues.

tinytankpu

I've noticed this all the time as well.
The More Results currently seems to be functionally useless and should probably be removed until it can get fixed to contain valid results. It is always exclusively duplicates of prior results, or results that have dropped quoted terms making them unrelated to the query.
As an early adopter of Kagi I've been using it for quite a while as my daily driver. Like all current search engines, anything that's not a Wikipedia instant answer is a muti-query search (though at least I can eventually get to something related with Kagi). Consequently I've been looking thru More Results dozens of times a day for years now, and at no point have I ever seen it produce any correct results.