I think one of the issues is that lots of people play fast and loose with the rules when moving about ... whether it be walking, bicycling or driving. And it's so easy to say "well I use this mode and I notice the people who use THAT mode are constantly breaking the rules and that's not safe!".
If there's a demand to enforce the rules more stringently in the name of safety, would those doing the demanding also want to see citations for jaywalking?