My default units are set to imperial; however, directions are shown with kilometers as the distance. Confirmed behavior on both Edge/Firefox on desktop and Firefox mobile. 
Units display on maps should match the user selected units. For example, while imperial is selected use of miles and yards instead of kilometers and meters.