ChatGPT Pipe Dream

JanKleine

I came across this chrome plugin. The idea is to display ChatGPT responses next to search results. I know this is probably a bit unrealistic with licensing and all. Honestly I’m not even sure if this a good idea in the first place, because it can be very confident while being wrong. But in any case I thought I’d throw the idea out there. Do with it what you want 🙂

Vlad

JanKleine The cost to do this on every search would double the cost of search. This is why we are thinking to make this on demand. Let us know if you have other ideas.

yokoffing

Vlad The cost to do this on every search would double the cost of search. This is why we ar ethinking to make this on demand.

What if there was a mode or a !bang that queried only ChatGPT? That way the search is limited to only ChatGPT and limits cost (i.e. no other indexes are used).

If ChatGPT returns an unsatisfactory answer, we could have a hyperlink below the ChatGPT response that would say something like "Keep looking" that triggers a normal Kagi search for the query.

yokoffing

display ChatGPT responses next to search results

I came here to post the same thing! lol. It would be awesome to implement.

Edit: Here's a good talk on how ChatGPT will disrupt search engines:

Vlad

yokoffing Thanks for providing this video.

We have the technology and we are looking for ways to include this in Kagi. It is not clear yet what is the best way to do it. Is it a sidebar widget?

yokoffing

Update: Just saw Mother! 😍

NoGoogle

I love this idea, but for the financial side of it, Vlad mentioned "This is why we are thinking to make this on demand". I like this concept as I personally don't need a quick go to answer for every query (especially if it's costing money) and sometimes I actually find the quick answers from Google annoying but for some searches I WISH there was just a magical box that would pop up and just end my endless suffering of searching on end with no avail from the start. Something like every paid account gets access to 30 free "on demand" answers every month (1 for each day of the month with Chat GPT). If a user want's more than 30 answers from ChatGPT a month, they can click the button for it which charges them per click to their next upcoming bill.

abcbcafe

I also think it's a good idea to consider AI assistance for future Kagi updates. Lately I've been growing increasingly addicted to both cGPT and copilot (and of course Kagi) for what essentially amounts to searching for information. OpenAI is inevitably going to start charging for cGPT, and if it's <= $15 USD I'll pay for it. Assuming it's $10/month, that puts my monthly "search" expenditure at $30. I'd have no qualms about paying $20 for Kagi if it includes something at the level of cGPT.

A couple of options to consider besides on-demand is

Allowing Kagi users to provide (and pay) for their own OpenAI tokens which they could use for Kagi widgets. That way there wouldn't really be any extra (opex) cost for Kagi. Kagi could still do some prompt engineering in the background, which would add value for customers.
Subscription tiers; perhaps $10 for traditional search only, $20 for AI assisted search.

That said, my personal pipe dream is to offload all my search to Kagi; $30 for traditional search + cGPT-equivalent + code assist/copilot IDEA plugin, and ditch github and openai entirely.

Vlad

abcbcafe Thanks for this feedback, it is excellent. We are already experimenting with LLMs like GPT3 (you can see try of our recent demos if you are on our discord).

The average cost of using these models is about 1-1.5 cent, just like search. So it makes more and more sense for us to start charging per use, both search and AI. As the price should not be the same who does this 1000 times in a month or 100. This is what we are trying to figure out now. Stay tuned for an update (_January)

NoGoogle

Having started comparing search results from Kagi to Chat GPT response's, it really shows how much more room there is to be done for improving Kagi:

5 minutes of searching Kagi for an answer to "can I transfer crypto from one hardware wallet to another?" to no prevail with unrelated search results

Whereas ChatGPT immediately answers yes and how to do it.

Vlad

NoGoogle We do not have GPT implemented in kagi yet. When we do it will be similar to ChatGPT but with source. Try here https://labs.kagi.com/ai/contextai?question=can+I+transfer+crypto+from+one+hardware+wallet+to+another

Omi

This is amazing, when do you think you can make this available for production ? I would love to pay extra for it.

Vlad

Omi Some time this month, it will be available for all subscribers.

Omi

Are you going to add it into the search engine or as a separate lense ?

Vlad

Omi We are still figuring out what is the best way to add this - there are many other AI tools we are considering at the same too.

fileyfood500

+1 chatGPT super excited for chatGPT functionality in search engines, and would pay extra for it too!

NoGoogle

Really happy to see how fast ChatGPT/AI is coming to Kagi but if it hasn't already been considered/before it goes live, it's good to bring up the privacy side. Using ChatGPT on OpenAi's website requires you give them a non VOIP Phone number. It's one thing to require phone numbers which at this point are widely connected to our SSN/real identities to use online services and another step to require they not be virtual numbers you can buy either. You have little privacy talking to ChatGPT at Openai.com. I hope whatever approach Kagi takes to implementing AI/ChatGPT is in a privacy preserving way. Anonymity is the key point/worry. It's one thing to have ways of using Kagi privately but it changes up the dynamics if one has to connect their own OpenAI account to Kagi. I hope all of this is being taken into consideration before release. Excited to see it come to Kagi.

Vlad

NoGoogle No worries, we are implemeting AI features without requiring user to do anything.