Steps to reproduce:
Send two separate queries to the FastGPT API, one after the other. If they sound too similar, FastGPT doesn't do a new query. Here's example output from a simple Python script I wrote to experiment with the API:
Enter a query or 'q' to quit: Is Salem Diner in Salem, MA still in business?
Query: Is Salem Diner in Salem, MA still in business?
- Link [1] states that the Salem Diner is a historic diner in Salem, Massachusetts.
- Link reports that the Salem Diner closed permanently on May 30, 2019 after 78 years in business.
- None of the search results mention the Salem Diner reopening or resuming business after May 2019.
</Scratchpad>
<Kagi AI Answer>
The Salem Diner in Salem, Massachusetts closed permanently on May 30, 2019 after operating for 78 years [2].
Reference count: 2
Enter a query or 'q' to quit: Is Miss Worcester Diner in Worcester, MA still in business?
Query: Is Miss Worcester Diner in Worcester, MA still in business?
- None of the search results provide information about Miss Worcester Diner in Worcester, MA.
- The search results are related to the Salem Diner in Salem, MA.
</Scratchpad>
<Kagi AI Answer>
I apologize, but none of the provided search results contain information about whether Miss Worcester Diner in Worcester, MA is still in business. The search results are related to the Salem Diner in Salem, MA.
Reference count: 0
Enter a query or 'q' to quit: Which has a higher population: Barrington, RI or Great Barrington, MA?
Query: Which has a higher population: Barrington, RI or Great Barrington, MA?
- Link states that the population of Barrington town, Bristol County, Rhode Island was 17,153 according to the 2020 U.S. Census.
- However, none of the search results provide information on the population of Great Barrington, Massachusetts.
</Scratchpad>
<Kagi AI Answer>
Based on the available information, Barrington, Rhode Island has a higher population than Great Barrington, Massachusetts. Barrington, RI had a population of 17,153 according to the 2020 U.S. Census [1], while no data was found on the population of Great Barrington, MA.
Reference count: 1
Enter a query or 'q' to quit: Which has a higher population: Exeter, RI or Springfield, MA?
Query: Which has a higher population: Exeter, RI or Springfield, MA?
- Link [1] provides population data for Barrington town, Bristol County, Rhode Island. This does not mention Exeter, RI.
- None of the search results provide direct population data for Exeter, RI or Springfield, MA.
</Scratchpad>
<Kagi AI Answer>
I do not have enough information to determine which city has a higher population between Exeter, RI and Springfield, MA. None of the provided search results mention the populations of these two cities.
Reference count: 1
A little later:
Enter a query or 'q' to quit: Is Miss Worcester Diner in Worcester, MA still in business?
- None of the search results provide any relevant information about Miss Worcester Diner or its business status.
- The search results are mainly about Barrington, Rhode Island and Great Barrington, Massachusetts.
</Scratchpad>
<Kagi AI Answer>
I do not have enough information to determine if Miss Worcester Diner in Worcester, Massachusetts is still in business. The provided search results do not mention Miss Worcester Diner.
Reference count: 0
Expected behavior:
I expect FastGPT to realize I'm no longer asking about Salem Diner and run a new query for the information I am looking for.
Debug info:
I'm sending requests to the https://kagi.com/api/v0/fastgpt with query and cache parameters, with cache set to false (the cache setting doesn't seem to make a difference here). According to the API response, I'm connecting to 'node': 'us-east4'
