Same arXiv link appears multiple times in results

nwoeanhinnogaehr

When searching for a topic that returns multiple results from arxiv.org, sometimes the results are duplicated 2-3 times. For example, in the below search:
https://kagi.com/search?q=matroid+interdiction&r=ca&sh=HUK42VHYLjBpe7brrRj16Q
This returns three links with slightly different titles but which are essentially pointing to the same thing: https://arxiv.org/abs/2310.05147 , https://arxiv.org/pdf/2310.05147 and https://arxiv.org/pdf/2310.05147.pdf (the last two are actually exactly the same file).

I would expect Kagi to (preferably) only link to the abstract page (https://arxiv.org/abs/2310.05147) or (less preferably) only to the PDF (https://arxiv.org/pdf/2310.05147) instead of cluttering the results with both.

Luis

nwoeanhinnogaehr Hello. Assuming these are also the results you see,

it seems that arXiv assigns different URLs to the same paper, resulting in multiple links in our search results.
Should we invest in developing a custom solution to consolidate these links, or do users find value in having multiple options? I'll mark this discussion as under review to invite further input.