What are you running it inside? VMWare, VirtualBox?
I had a tough time trying to get my Aeotec Gen5 Zstick to passthrough.
I'd love to know what your setup is, since it sounds like you've been successful in connecting USB devices to HA. Thanks in advance!