In this sentence (You can add up to 6 people, but less is fine.), you should use the word "fewer" instead of "less".

Fewer is for finite, less is for infinite. (fewer apples, less flour)