If you use a bunch of separate libraries from different developers, then you have to write a lot glue code to get data between those libraries.
That code is usually slower, as it will involve copying and transforming data, i.e. you'll be copying data in and out of different classes, copying data to memory allocated by the library, copying data to differently aligned memory, transposing data, copying data between different sized scalar types etc.
Frameworks make cross platform development a lot faster, and learning a framework is no more of a waste of time than learning another language or native OS api.
I absolutely agree, that bundling together a bunch of dependencies, and having those dependencies maintained by the same vendor has a risk/cost.
Don't choose a shitty or faddish framework; put as much research into choosing your framework as you would into researching it's individual libraries, use the framework as it was designed, and only use what you need.