Some ways that might be true I can think of are if you are someone who doesn't build any emotional connection to the other person whatsoever, and always just "do sex" your way, without much of the other person's involvement.
Otherwise, strong disagree, as emotional involvement, which depends on so much more than if someone is "higher than 6", and the dynamic of pleasure of getting, and of giving, which highly depends on the other person, are 2 factors I'd say far outweight physical appearance.
Even without you as a factor, sex with a 10 can be very lousy, while sex with a funny, caring and passionate 5 can be out of this world.