Thinking further I could get the result I am looking for by making a lens and that only searches YouTube and then my channel rankings would appropriately rank, but you still have to set them to neutral before upranking them.
It would be nice if when searching videos, YouTube videos default to channel ranking, since most "channels" are on YouTube anyway, and honestly so are most videos.