Lens results don't include all specified sites

cyberpunk

Steps to reproduce:
Not sure if this is a bug or intended behavior (in which case, it would be great to understand why), but here's the situation: I created a news lens and added these values to the websites to include: dailywire.com, wsj.com, foxnews.com. But no matter what search term I use (for example, "economy"), I don't see any results from dailywire.com, only from the latter two. If I create a lens only with dailywire.com, then I do get search results.

Expected behavior:
I expected to see search results from all websites listed which include the search term.

Debug info:
Kagi web / latest version of stable Chrome / latest version of stable macOS

Vlad

cyberpunk It would probably mean that other sites have stronger relevancy. Perhaps removing one of the other two would yield results?

cyberpunk

Vlad Thank you for taking the time to answer. Yeah I suspected it was related to relevancy. It just struck me as odd because no matter what search terms I used, results from dailywire.com never showed. I must have loaded over 200 results in total and not one of them was from this site.

I did another test now, where I copied the exact title of a recent news article from that site (published in the last week) and pasted it into Google; they surfaced that article as the first result. I did the same on Kagi; the article was the second result. I then used the Lens I created that has the three websites I mentioned in my first post, and this article is nowhere in the results (in fact, the total number of results after expanding the first page is 13 instead of 20).

So there seems to potentially be a bug in the way results are returned after running it through a user-created filter? Or what would explain the issue described in the above paragraph?

Vlad

cyberpunk Can you share those steps to reproduce?

cyberpunk

Vlad I just did about 10 different searches using the steps above, and I only ran into one case where the search result didn't show up when using the lens (but did show without it). I'll keep testing as I continue to use Kagi, but here are the steps:

Enter in Kagi: WATCH: Tucker Carlson Torches U.S. Senate Candidate John Fetterman

A link to the article (https://www.dailywire.com/news/watch-tucker-carlson-torches-u-s-senate-candidate-john-fetterman) should be near the top.

Then apply a user-created Lens with these values for the setting "Include only these sites in results (up to 10, comma-separated)": wsj.com, dailywire.com, foxnews.com

The article won't appear in the search results using this lens.

Question: do search results using lenses take into account the ranking the user has given to a website? In my case, since I've ranked Daily Wire as "High", I think it would be reasonable to expect that I'll see results pointing to it when using a lens that includes this site. But even if that's the case, I understand there needs to be an underlying relevancy setting at the search engine level to deal with the case where all the websites in a lens have the same user-assigned ranking.

Separate thing that I noticed is that some of these results aren't actual articles; sometimes they're PDF documents, sitemaps, lists, etc. Unrelated to the issue this thread is for, but just an FYI in case that's useful to know.

Vlad

cyberpunk Thanks, I can reproduce the issue.

It seems to be an edge case in the way we conduct lenses search. Good news is that it should not surface often (only the most recently published pages may be affected by it)