I rather suspect it's simpler than you think. Attractive-from-behind people are attractive by virtue of their figure. Before they turn around, everything we have seen we find attractive.

Unless you find every person you see from behind first, initially attractive. But I know I certainly don't.