Is it in the realm of possibilities that you can buy a bigger house with more bedrooms and then convert them into office space? That's what lots of folks do... There are many, many advantages of doing so.
You mentioned you needed to bring clients and investors to the office. As someone said, investors often like to see the bootstrapper be creative so you'll get bonus points. Some clients will be put off; others will think it's great - only you know. Sorry if this takes you off the track of your question.
To answer your question: you know what the best thing to do is. Asking for advice here is futile since, as you can see, you get so many different types of answers. Trust your instincts; no one knows the business better than you.