alltheseas This arrow style rubs me the wrong way so to speak. I immediately think "Oh move this row up and down"
I'd kind of prefer something subtle and in-line with the results... probably below. There is already one button in the upper right with a menu and that's exactly the correct number of obvious button/widget/icon/things in this context.
Might be a good opportunity to create a ..subtle widget or context bar, or some (eh not my favorite) hover area.
I'm really clutter adverse, and in-line with the results (and subtle) seems like less of an unintentional attention grabber. This is a preference control, not contextual information. Don't make it jump out at you, your eyes can hunt for it when you need to find the control.