I am unsure what to think of the translations so far. I have ran several Japanese Manga titles through the translator of which I roughly know the literal translation and the "official" translation that's adjusted for better marketing.
Kagi Translate, without fail so far, picks the "official" translation.
Example 1: Sousou no Frieren
"Official" Translation: Frieren: Beyond Journey's End
"Actual" Translation: Funeral Frieren/Frieren at the Funeral (a wordplay regarding the story that was hard to translate, hence the "official" translation being vastly different)
Structure:
Sousou - Funeral/Being at a Funeral (https://www.nihongomaster.com/japanese/dictionary/word/38572/sousou-%E8%91%AC%E9%80%81-%E9%80%81%E8%91%AC-%E3%81%9D%E3%81%86%E3%81%9D%E3%81%86)
no - syntax link indicating the prior
Variant: Sousou no Naomi / Sousou no Naomisan
Here the translation does not pick up on the fact that Naomi is a name without providing a honorific. Once it does it translates it as if Souous meant Journey. Arguably wrong.
Variant: Sousou no Hana / Sousou no Hanasan
No idea where this thing suddenly pulls the underworld from but at least it is somewhat related to "Funeral"/"Burial", however it does not pick up on Hana as a name even with honorific.
Variant: Sousou no Mark
(picked a random western name for this one to see if the honorific problem was isolated to japanese sounding names)
Uhm....what?
Unfortunately I don't have an IME at hand rn to test whether this happens with Kana input as well or if this is isolated to Romanji translations.
I don't really know if this is even something that can be fixed outside of better LLM models but I thought I'd share my findings so this odd behaviour is documented somewhere. The problem is likely to go away with more input as the LLM gets context (at this point I'd like to second this opinion about an additional context field johen. It seems needed when the translator can stray this far off course without it.)