RGB based detection will probably be too slow and error prone. Rather put active IR LEDs or similar markings which can be easily detected, use cameras which only let through IR and high framerate! Then use computer vision to spot blobs. Finally compute 3D position by triangulation.
Active IR tracking is still pretty much State of the Art for motion capturing and the like.
Short googling leads to OptiTrack, where they even advertise exactly this use case of drone tracking: