What about talking to your boss?
This situations tend to be very random because every company and every boss behaves different. Some don't notice, some don't care. Others fear for their business, feel betrated or are just angry.
Speaking often helps, especially when you make this an open conversation: "Hey, I've been working on this project in my spare time and I realized that this might be a conflict of interest. What do you think?".