Many businesses start out just like you describe. If you did all of your work off the clock and you're not using any intellectual data or proprietary processes you should be in the clear. Keep any concept designs or specifications just in case. I have friends who started their business on the side, left their employer, and then the employers became their customers.