(http://flagsarenotlanguages.com/blog/why-flags-do-not-repres...) is a starting point.
Basically
- some languages are spoken in more than one country (eg. English in US, Britain, Australia, India)
- some countries have more than one language spoken in them (eg. see any large country)
- you will end up accidentally annoying people when you accidentally get it wrong. (is Cantonese, Tibetan and Mongolian the same language as Mandarin? You realise they are not mutually intelligible and come from different language families?)
I suggest you write the language name in the language itself. If you desperately need something short use the Unicode language codes.
Edit: Really like it. Definitely continue.