Everything you said seems to be valid if you replace 'exponential' by 'f' where 'f' is any real analytic function.
exp(f) = lim_{n \rightarrow \infty} (id + f/n)^n,
but yes there are lots of other functions you can define more generally. The exponential just comes up particularly naturally.