Admittedly due to the nature of Vue syntax, it's harder to make a mess because everything is just key/value.. but then you have to learn an API to express things in that way. I enjoy the fact that you don't have that layer/step with react.
I definitely feel that the 3rd party classnames package should be built into React, I agree that out of the box conditional class names look a mess.
I don't have enough experience with either library yet to form an opinion on which I prefer, but I definitely appreciate not having the mental overhead of remembering the vue api. I'd rather have a bit of code that's more explicit/"just javascript" than have to think "what's that symbol I need to use again?". Definitely a personal preference thing though!
{items.map((item) =>
item.display && (
<SomeElement
onClick={(e) => e.preventDefault() && foo()}
className={classNames({'current': item.active})}
/>
)
)}