Another problem I've seen quite often in regards to Riot performance is that viewing large images in an E2E room results in massive lag within Firefox (on Linux at least).
Presumably it's because you're decrypting a 5MB image in JS, but it seems a little bit odd that the entire browser effectively locks up as long as the image is visible.
It's not the end of the world for me, but it is fairly frustrating (the people I talk to use the Android app and don't have this problem, leading).
Keep up the great work Arathorn (and the rest of the folks working on Matrix/Riot)! I've been donating quite a bit to the Matrix project ever since you started accepting funds, and I don't regret it one bit.