InstructLab and the Granite Models from IBM seem the closest to being open source. Certainly more than whatever FB is doing here.

(Disclaimer: I work for an IBM subsidiary but not on any of these products)