It's a problem with the phone's aluminum construction. A phone like the Note 3, made with less premium-feeling plastic, responds better to stress like this. It can be bent, but it just bends right back with no permanent bend left.
The aluminum phone yields, undergoing plastic deformation, while the plastic phone deforms elastically.