I'm not clear why you are blaming SGD. Maybe I missed the point. In principle SDG might well find the global optimal. The problem is this optimal is achieved only for training data. It could certainly perform worse on the test set. Maybe you are referring to the entire training process? The general idea is from the days of SVM's where the optimization method was convex.
Though personally I do find a lot this modern "experimental" research quite hokey. I don't think this is something academics should be getting research funding to pursue. This is engineers building intuition about how to tune their product.