New York State:
1. When you incorporate an LLC in this state, they require you to publish your LLC's incorporation in two different newspapers, at a cost of about $1200. They choose the newspapers.
2. Their LLC incorporation website only works during business hours. Yes, that's right. The website only works 9 to 5.
3. They can only receive information by fax and mail and the fax numbers don't work.Then you register it as a foreign corporation with your state's Secretary of State.
Incorporating in your own state is unnecessary, unless you have a fixed business location that is always staffed during business hours, and are keen on avoiding registered agent fees.
Just incorporate in Delaware. Administration of U.S. corporations is their cash cow. They can't afford to make the process too burdensome, or some other state will eat their lunch.
You have to really know what you're doing and be willing to actually live there. If you're CA based, the FTB will find you. They're 10x more ruthless than the IRS.
Its easier just to do it in your own state. If it ever really matters, you'll have a ton of money and an expensive lawyer to deal with it for you.
Also, if you're not wedded to the simplicity of an LLC you can start an S-Corp in NY state inexpensively and with no publishing requirement–though with more overhead and differences in structure.