I graduated with a traditional engineering degree too and the start of my career sounds similar to yours.

Here's my advice: Pursue what you are interested in. If you don't you will always have a nagging what-if feeling in the back of your mind. Nothing is set in stone and if you decide later that the EE path is more appealing you can get back into it later.

It might be a little harder to switch back but IMO the reward is worth the risk. Since you're a recent graduate, right now is a good time to try stuff out.

Good luck.