I’ve found that (and I have Ultimate):
!fast and !expert don’t actually change the assistant mode. The search ends up using whatever I used last.
If I last used Fast mode and search for ‘!expert test’ then I’ll get the results in Fast mode irrespective of the bang. The same happens the other way around too.