Huge improvements to Google Bard launched recently, including much needed improvements to "Google It", a feature in Bard that uses Bard to fact check its own claims using context from search.
https://blog.google/products/bard/google-bard-new-features-update-sept-2023/
When Bard makes a claim, simply click the Google It button and it will do the following:
- Generate search queries relating to its claims
- Execute the search results
- Comb through the search results and find supporting or unsupporting evidence of its claims
- Return its text highlighted in green (it found supporting evidence) or brown (it hallucinated 😵💫) along with direct quotes from the search results
Assistant in Direct mode with GPT-4, Claude 2, etc. does not have access to the Internet, so having a Kagi It button would help validate its claims.
Using research modes would alleviate this problem, but search results will often handicap the model's creative abilities. Adding an optional fact check option in Direct mode would combine unrestricted creativity with factual accuracy. This could be applied in Code mode as well.