Leaving emacs open makes it more IDE like, the stuff you were working on last is still loaded. Instead of having to quit and then find all those files again. I work the same way as you. Tabs for any large number of buffers would be a nightmare
But I agree with you, I hate quitting vim, it seems like I lose my place much easier when I no longer have those files open.