If you want a _really_ lightweight matrix client, I'd say <300 lines of Go would be pretty light. Go is quite portable too:

https://gitlab.com/meutraa/mm/tree/master

For the chat there is weechat, but I do not think any of lightweight the clients with audio support are mature.