Apparently puritains and others of that ilk regarded dice as instruments of the devil
[1] https://en.wikipedia.org/wiki/Cleromancy#In_Judeo-Christian_...
https://www.atlasobscura.com/articles/dice-evolution-fate-fa...
In summary, even if the old dice were not fair, it was not an issue because they were a manifestation of the divine.