As a tourist when you have all the time in the world, I would agree it's part of the charm. When the development of your economy depends on such a neglected and terrible line, it's an unbelievable nightmare for people living in either country (Personal anecdotes support this).
On the other side of the equations are superfast trains like the TGV, this one is expensive but in my humble opinion it is faster than plane on routes like Paris-Lyon and I'll take train over plane on any day at distances shorter than 500-700km.
There is an ongoing development, Rail Baltica, European gauge, being built to join Helsinki through the Baltic states, to Poland, which will link up with Germany. The end date has slipped (it was supposed to be in 2024, now it's pushed to 2026) but construction is already ongoing, and it looks quite promising.