As far as I've seen, that's really the only way. Maybe with a slight throttle for the onMouseMove handler if the performance isn't great.
I wonder if a different UX would help? Like clicking on a card and clicking on the drop target instead of dragging it? It would be less tactile but also a lot nicer on a trackpad.