ChatGPT Pipe Dream

abcbcafe

I also think it's a good idea to consider AI assistance for future Kagi updates. Lately I've been growing increasingly addicted to both cGPT and copilot (and of course Kagi) for what essentially amounts to searching for information. OpenAI is inevitably going to start charging for cGPT, and if it's <= $15 USD I'll pay for it. Assuming it's $10/month, that puts my monthly "search" expenditure at $30. I'd have no qualms about paying $20 for Kagi if it includes something at the level of cGPT.

A couple of options to consider besides on-demand is

Allowing Kagi users to provide (and pay) for their own OpenAI tokens which they could use for Kagi widgets. That way there wouldn't really be any extra (opex) cost for Kagi. Kagi could still do some prompt engineering in the background, which would add value for customers.
Subscription tiers; perhaps $10 for traditional search only, $20 for AI assisted search.

That said, my personal pipe dream is to offload all my search to Kagi; $30 for traditional search + cGPT-equivalent + code assist/copilot IDEA plugin, and ditch github and openai entirely.

Vlad

abcbcafe Thanks for this feedback, it is excellent. We are already experimenting with LLMs like GPT3 (you can see try of our recent demos if you are on our discord).

The average cost of using these models is about 1-1.5 cent, just like search. So it makes more and more sense for us to start charging per use, both search and AI. As the price should not be the same who does this 1000 times in a month or 100. This is what we are trying to figure out now. Stay tuned for an update (_January)

NoGoogle

Having started comparing search results from Kagi to Chat GPT response's, it really shows how much more room there is to be done for improving Kagi:

5 minutes of searching Kagi for an answer to "can I transfer crypto from one hardware wallet to another?" to no prevail with unrelated search results

Whereas ChatGPT immediately answers yes and how to do it.

Vlad

NoGoogle We do not have GPT implemented in kagi yet. When we do it will be similar to ChatGPT but with source. Try here https://labs.kagi.com/ai/contextai?question=can+I+transfer+crypto+from+one+hardware+wallet+to+another

Omi

This is amazing, when do you think you can make this available for production ? I would love to pay extra for it.

Vlad

Omi Some time this month, it will be available for all subscribers.

Omi

Are you going to add it into the search engine or as a separate lense ?

Vlad

Omi We are still figuring out what is the best way to add this - there are many other AI tools we are considering at the same too.

fileyfood500

+1 chatGPT super excited for chatGPT functionality in search engines, and would pay extra for it too!

NoGoogle

Really happy to see how fast ChatGPT/AI is coming to Kagi but if it hasn't already been considered/before it goes live, it's good to bring up the privacy side. Using ChatGPT on OpenAi's website requires you give them a non VOIP Phone number. It's one thing to require phone numbers which at this point are widely connected to our SSN/real identities to use online services and another step to require they not be virtual numbers you can buy either. You have little privacy talking to ChatGPT at Openai.com. I hope whatever approach Kagi takes to implementing AI/ChatGPT is in a privacy preserving way. Anonymity is the key point/worry. It's one thing to have ways of using Kagi privately but it changes up the dynamics if one has to connect their own OpenAI account to Kagi. I hope all of this is being taken into consideration before release. Excited to see it come to Kagi.

Vlad

NoGoogle No worries, we are implemeting AI features without requiring user to do anything.

quinncom

Since getting access to ChatGPT Plus, I'm using it for 90% of my search needs. Like others have mentioned, virtually any search terms I would enter in Kagi or Google is given a valuable response by ChatGPT. Occasionally, I'll follow-up with a Kagi search to verify if the reply is realistic.

Now that ChatGPT is available via API with fair pricing, I would be willing to pay per-query to have a ChatGPT reply alongside my search results.

@Vlad, if you will not be including GPT replies in Kagi because of cost, please allow us to provide our own OpenAI API keys to Kagi so that we can pay for the API usage.

Alternative to that, I'm considering creating a browser extension that injects a GPT reply on Kagi results pages. This is just too useful to ignore. It should be integrated into Kagi by any means, even if customers have to pay for it. 🥺

gpt-3.5-turbo only costs $0.002 / 1K tokens. If I use 1k tokens/query * 1000 kagi searches/month = only $2/month.

quinncom

Mockup: just put it to the side of the search results, like bing chat. If the window is too narrow, it can be displayed above the search results with the text truncated and a More link to expand the full response. The Regenerate response button is there, as is the prompt input, so you can continue querying chatgpt right on the page.

quinncom

Although, I'm not sure the "bring your own api key" would be easier to implement than just integrating the charges to Kagi's billing system and passing the charges onto Kagi users.
The latter option has other benefits:

With the aggregate Kagi user queries to ChatGPT you might be able to negotiate better pricing with OpenAI.
You can charge Kagi users slightly more per token to help pay for the implementation cost of this feature.
Users won't need to open an OpenAI account or mess with API keys.
If a better alternative to ChatGPT is released, you can switch to the other API without requiring users to replace their OpenAI API keys with, e.g., GCP Bard API keys.
As mentioned by mazen, some users can't create an OpenAI account because of their country.

mazen

I know this is the most complicated option but it would be best if you offered both an option to add your own API key or to pay more (or disable ChatGPT completely).

This can be something like: 2 searched used instead of 1 search per search query/+(5/10/15 usd or however you want to price it) for ultimate plan

This would be useful because OpenAI doesn't actually allow users from all countries to use its services for some reason. I am from Egypt and I can't make an OpenAI account even though there are virtually no other services that block Egyptians from making accounts and there aren't any sanctions or political drama against Egypt. I'm not sure how many other countries aren't allowed into OpenAI.

Of course there are ways around it, I already have access to the free ChatGPT through using a VPN + a virtual number, but it would be more complicated if I needed to use a credit card to pay for an API.

Vlad

Any ideas how would something like this be triggered from kagi interface and more importantly from browser address bar (to prevent an extra search)

Vlad

Revitalizing this discussion - I think Quick Answer and Assistant changed things a lot. is there any desire for this in kagi search now?

quinncom

Vlad Quick Answer satisfies this feature for me. If you query wtfjs? the Quick Answer response is just as I envisioned in my mockup (better, actually). Thanks! 🍻

« Previous Page