I asked Claude 3 Opus about illustrated book covers, and it added a pointless mathematical formula to each response, from telling me how to represent two squares rotated 45 degrees from each other, to calculating the average cost of books due to economies of scale—none of which contributed anything meaningful nor useful!
I suspect the system prompt's instructions to output formulae as LaTeX is at least partly the culprit.
I would expect it to only give me math equations when they're relavent to my question or the answer.