Sounds more like dwarfs. Pretty confident Bilbo's house did not have any other homes connected to it. It was built into the side of a hill as a standalone home.
This is always how I've imagined my dream house to be. Energy efficient, immersed in nature, easy to hide if necessary.