Add "report bad results" button

Kagibeh

that doesn’t address the inherent tension between users wanting to be as helpful to the Kagi team as possible, especially when it comes to reporting bugs which often requires posting screenshots or videos for reproduceability, while also preserving privacy as much as possible which is also one of the goals of Kagi.

That sums it up nicely. This is about having to make a choice between helping and privacy, in a place that advocates privacy.

And I don't think Kagi is comparable to the average open source project. When I post a bug or two with some specific app or other software, this doesn't breach my privacy. But kagifeedback.org covers a lot of topics, and over time, people post a lot of different things.

Here's what Kagi gave me the other day:

Who is Vlad on Kagifeedback.org?

Based on the information in the provided knowledge, Vlad is the founder and CEO of Kagi Search. The key details are:

Vlad is listed as the "founder and CEO" of Kagi in the status update on the Kagi blog. [1]
Vlad's Twitter handle is @vladquant, and he is described as the "Founder" on his Twitter profile. [2]
Vlad is also associated with the Telegram channels @GTProtocol_founder and @vlad_rzhk, which appear to be related to his work. [3][4]
Therefore, Vlad is the founder and CEO of Kagi Search, the company behind the Kagi search engine and the KagiFeedback.org platform. [1]

Vlad, I hope you don't mind me posting this, as this information isn't all that exciting or new. What I found very interesting, however, is that Kagi got it by piecing together information from different websites (and that's what blog.kagi.com is - a different website). As AIs become stronger and better, I expect to see more of that in the future, and those who use the same nicks over various forums on the Net are probably going to be the first to regret their choice.

If I post my stuff on Facebook, this is what I asked for, because sharing stuff with the public is one of Facebook's goals. A place that explicity aims for privacy should be more cautious, however, and if it isn't, that's an inconsistency to say the least.

CrunchyFritos

Kagibeh Here's a good example from the front page of KagiFeedback.org today. The user wants to be helpful by posting a screenshot of a SERP with a bug, but as a result, the user publicly reveals interest in this specific book and the corresponding topic. For example, is he dissatisfied with his job, looking to "quiet quit", etc.

That said, I'm not sure what the best solution is: it's not clear that making kagifeedback.org would necessarily address the privacy concerns even as it makes it harder for users to participate. My best effort at offering constructive feedback is to suggest that there is an extremely low-friction way to send a private bug report rather than posting publicly on kagifeedback.org. And that feature requests and bug reports where users aren't concerned about privacy can still be posted and discussed on the public kagifeedback.org forum.

For example, when clicking "Report a Bug" on the front page of kagifeedback.org there could be a radio button or option that allows a user to opt in to making the bug report public, along with a line explaining the benefit of doing so (higher visibility, the potential for it to get prioritized sooner if other users have a similar issue, etc.). The default would be private.

"Suggest a Feature" could stay public, or it could also have an option but be public by default.

Kagibeh

CrunchyFritos

Here's a good example from the front page of KagiFeedback.org today. The user wants to be helpful by posting a screenshot of a SERP with a bug, but as a result, the user publicly reveals interest in this specific book and the corresponding topic. For example, is he dissatisfied with his job, looking to "quiet quit", etc.

Yep, that's a nice one. Using my typcial "Who is..." I get the user's LinkedIn profile, his current career and lots of other interesting stuff. If I were his boss, I'd be truely worried that the guy is trying to reclaim his life from work. Hell, if he'd ask me for a raise tomorrow, I'd definitely say "no" to that.

Vlad

CrunchyFritos This should be solved via a truly privacy respecting mechanism for example https://kagifeedback.org/d/3829-add-a-way-to-report-poor-search-results-anonymously

Placing more hurdles to use the forum does not achieve that goal and runs into other problems described here.

Ashok

While using Kagi, i have found that some results for searches are SEO spam more so than helpful responses. With this in mind, it would be helpful to give Kagi feedback in the search results itself so that the product can improve. My assumption is that you need the data of which sites are being returned for search results that have low/no utility to the end user. (i have this problem a lot with medium website when doing product searches for "best [blank]"

Vlad

Ashok We already have a mechanism for that and it is called domain personalization (you can block or lower them) and you can find what aggregated stats look like at https://kagi.com/stats

Problem with any sort of human based quailty moderation will be that "one man's trash is another man's treasure" and it is not clear for us what criteriashould we employ and how other than what we are already doing (downranking sites with lots of ads and trackers)

kagi134

I downranked all medium sites for this very reason.

Ashok

Sounds great. I'll be sure to downrank in the future. It just seems that there is something happening where Kagi isn't picking up what is useful. I'm not saying that banning all of medium or anything like that is the right answer. it just seems like spam like results are appearing higher up than i would hope. My assumption is that no one would feel that the spam would be treasure, that's why i bring it up here. Thanks for responding!

Vlad

Ashok It would be useful if you gave a few concrete examples.

Ashok

Vlad Sure thing. When it happens to me again i'll be sure to try to post an example(s) here. Though since i downranked medium i have stopped getting those posts. If i have time, i will change my setting back to standard and send some examples over when possible.

Fernandez

Vlad Sometimes, Kagi will serve irrelevant results. It also means "poor search result"
For example, I search "gemini 1.5 pro performance", below is the result I get:

The third result (Speedometer 3.0: The Best Way Yet to Measure Browser...) has nothing to do with my search term, thus, it is a poor result. However, simonwillison.net is a pretty good blog site, it's nonsense to downrank this domain.

I think, Kagi should provide a button (or whatever method) for each result to let user tell Kagi when it provides an irrelevant result. And Kagi can improve its search quality based on these kind of feedbacks.

Vlad

Fernandez Yes this comes from our small web index, and the result in question mentions "killer app of gemini pro 1.5 is video) so it is somewhat related , perhaps just ranked too high.

« Previous Page