They had different letters for the same sound but different duration, such as Omega (ω) an Omikron (o) which means O-big and O-small.
The only problem is that we don't really know the exact vocalization of all the various letters and notes (notes as combinations of letters, for example ΟΙ or ΕΙ) which have the same vocalization in new Greek. We do have however some clues as to how they were pronounced.
All in all, because I have been following the subject for some time, we can't reproduce the music as it was. We have some directions as to how to rebuild the instruments and that's the best lead up to date, but still that's up for much debate as to how accurate the reconstruction is.