Background
I use Obsidian to take notes. It's a markdown-based app, that allows me to create internal links between notes. Similar to Wikimedia. I will often create a link, when I mention someone or something, without creating the note. Today I thought I'd try to use AI to help fill the blanks.
I pay for Kagi, so I thought I'd try FastGPT.
Goal
I have a list of 1 200 titles, that I want the AI to sort into these groups: Book
, Article
, Organisation
, Person
, Case law
, Legislation
and Assorted
.
The issue
In the web interface, there is no input limit. But a longer query is more likely to get Sorry, a problem occurred (…)
. I tried the Firefox Extension. Results varied. Tried the Chrome extension. Same story.
I thought: “Fair. My query takes extra tokens, so maybe I should pay for the API.” I paid for the API.
Exact same problem. But now delivered in JSON:
{"meta": {"id": "x", "node": "europe-west4", "ms": 4253, "api_balance": 5.0}, "data": {"output": None, "tokens": 0}, "error": [{"code": 0, "msg": "Sorry, a problem occurred while processing your request. Please try again later.", "ref": None}]}
I need clarity: What are we paying for? What is the non-descript problem? Is it query length? How long can a query be? Is there a way to make several queries in the same session, so the categories don't have to be repeated for each?