You might be interested in the work of Andrew Head, in particular his team's Formula Formatting Language: https://andrewhead.info/assets/pdf/ffl.pdf - I have not tried it myself though.