Don't work on your project during the office hour, or allow your project to affect your performance at work. There are two main reasons:
1. The employer is paying you to help their product/service succeed. It is unprofessional and immoral to deceive them. I've seen some colleagues do this and I was disappointed in them.
2. Work you produce at your place of employment belongs to the employer. It depends on the contract and I am not a lawyer, but it's best to protect your intellectual property.