Will Kagi members have access to the OpenAI o1 large language model?

nicoty

OpenAI recently released an article showcasing their o1 LLM which features significantly improved chain-of-thought reasoning over earlier models and better performance on various benchmarks, as a result. As such, I'm wondering if Kagi will be adding it as one of the models available for Kagi members to use?

On a related note, @Vlad stated previously that "All members will have access" to the Assistant when it comes out of open beta (with the caveat that GPT-4 will only be available to Kagi Ultimate members). Now that the Assistant is out, please can someone tell me how to access it as a Kagi Professional member?

pravinxor

nicoty If they were to do so, it would probably be extremely rate limited. At the moment, the RPM (requests/minute) is at 20 for o1-preview. Keep in mind, Kagi is probably using just 1 (or a couple) OpenAI keys to fulfill requests to the assistant, so this 20 requests/minute would be affecting everyone across Kagi.

I would like to see Kagi implement this feature where you get a few requests per day for now, given the API limits, however, since it just looks like a simple drop in change for the model on API code.

Details: https://platform.openai.com/docs/guides/rate-limits/usage-tiers?context=tier-five

Vlad

nicoty While Ultimate tier will eventually get access to o1, I doubt it will be avaialble to non-ultiamte any time soon just due to prohibitevely high cost.

In the meantime you can check Kagi LLM benchmarks to get a sense of how good these models actually are.

https://help.kagi.com/kagi/ai/llm-benchmark.html

lexlexlex360

Vlad While Ultimate tier will eventually get access to o1

How will this be communicated?

Luis

lexlexlex360 these type of updates are usually communicated through our release notes, https://kagi.com/changelog

dreifach

Is there a roadmap/timeline on o1’s availability? There are some tasks I have to revert to my ChatGPT subscription for, which I want to cancel.

JJ

Will we have access to OpenAI-1 Preview and OpenAI-1 Mini in Assistant? I understand that API access is limited to those who have paid a significant amount to OpenAI in API usage fees. However, both models are exceptional, ranking among the top LLMs in several categories.

he inclusion of ChatGPT-4.0 (O1 Preview and O1 Mini) in Kagi Assistant would significantly enhance its functionality by offering more dynamic, context-aware interactions, capable of multi-step reasoning that's highly suitable for complex queries. O1 Preview provides in-depth conversational capabilities for complex queries, while O1 Mini offers quick, concise responses for more straightforward needs. Both models can improve efficiency and user experience by adapting to different search complexities, making Kagi even more versatile and user-friendly.

Vlad

JJ These models are good for very limited use cases, and bad for search/coding (check Kagi LLM benchmarking project). On top of that they are extremly slow, expensive and rate limited. So we are not in the rush to add them.

Thibaultmol

depends on what level of developer that Kagi is with OpenAI

JJ

Thibaultmol
That's $1000 spent on API access so far in order to qualify for Tier 5:

I would think it's likely Kagi qualify for that. But we'll have to see when someone from Kagi responds to this.

Thibaultmol

I know this probably is also a condensation solution, but honestly I wouldn't mind having "very specific, expensive, doesn't make sense for most people" models like o1 being 'pay per use' extra on top of an existing kagi subscription