Even without the wind, the separate words help. In crew (rowed) boats, people sit backwards. And then boats are stored on racks upside-down. It can get complicated!
Strokeside is always port, even if in that particular boat stroke's oar is actually on the starboard side- and even in a sculling boat!