Yup already thought about that but IMO it's much more work and prone to errors compared to just installing some sensors. Want to get that running ASAP and after that we can look into CV options. Already found a project [0] that tried to accomplish that with OpenCV but it seems it's abandoned.

[0] https://github.com/StudentCV/TableSoccerCV