Pagespeed is absolutely one of the worst plugins in the world. mod_pagespeed for apache is garbage, and permanently breaks some websites when removed. I see no reason why the nginx version would be any better.
(I work on mod_pagespeed, and if we're breaking sites on removal that's something I want to look into.)
I "worked" for months with Jeff and his team to find a real tricky bug to catch (well, they mostly did the work, I sent the bug reports) and they went above and beyond to find and fix that bug. (Remember the #1048 issue?)
I definitely recommend MPS, it will not "break your website".
Elaborate?
I'm very curious about what could have made your experience that bad. Mind elaborating?
side note: I never used the ngx plugin, for good reasons: it's never been a real priority for the MPS team who seems to be focusing on the Apache version.