It is a problem if your environment includes ferro-magnetic crud. All my lab's magsafe ports are wobbly and it's hard to clean them out.
I think some of it in my bag is from a black sand beach. That stuff kills headphones as well as wonkifying magsafe sockets.