i'm not sure how casual gamers feel about it, but i find the motion controls extremely frustrating and they make games significantly worse, IMO. this might be more of a matter of opinion with better motion technology but for Skyward Sword the motion technology simply isn't good enough. i can test several motions to try to find the right one and do them carefully and both 1) struggle to do something successfully at all 2) find the identical motion gets variable results in game. Not fun. if the motion controls in Skyward Sword were equivalent to buttons at least they'd be simpler and I'd be able to mostly do the actions i want.
And I say this as a fan of the Infinity Blade iOS touch sword fighting games. if the non-button technology is good quality and the game actually makes sense with the controls, then it's fine. skyward sword fails on both counts.
Meanwhile in Link Between Worlds it breaks the flow of the game every time you want to change items or take the broom because you have to use the touch screen for those (which probably means pulling out the stylus since the touch screen sucks), and the whole rest of the game is buttons. the break in the action to grab your stylus, press twice, and set it somewhere again (on your shirt and hope it doesn't fall on the ground?) constantly interrupts you and does not add any fun.