When all the developers are the founders your approach will work. If you have a different dev team it is very very difficult to make your team so dedicated as you are. I think we have such a team but still having a system to put all the user stories on the same page and see how the team is moving helps a lot. If you reduce Agile to hyper specialization you loose a lot. It helped us a lot by:
- defining what Done means
- setting goals so we can release something new every 2 weeks
- measuring our activity: what doesn't get measured doesn't get managed
etc
And it is not about telling people how to do things. They decide how to do it, how long it takes etc... So I think you either got that wrong or I explained it badly!