How are they determining that it is a VoIP number? I don't have any insight on this, so any info would be appreciated
One way that I know of: Twilio and (probably) other providers let you programmatically look up the number provider details for a given number.
There are services online that the big providers can use now that give them this info. I don't have one to hand but I've seen then when I've gone hunting for the answer to that exactly question.
I really don’t know what you can really do about it since using a VoIP number is one of the strongest signals the account is for spam.