If anyone else is getting extremely irritated by this, temporary fix is to apply custom CSS in your Kagi settings:
.__srgi:hover .__sri_more_menu_box .__sri_more_menu {
display: none !important;
}
Note this also hides the dropdown dots for sub-results.
I tried this snippet, which only hides the AI button, but the text layout still gets affected.