Well, its bit harder at these stages since you lack the basics. I would personally invest a bit of time into learning HTML/CSS, and playing around in Photoshop.
If you choose to buy a design, you have MonsterTemplates or ThemeForest, but you'll have no idea on how to customize them without some HTML/CSS knowledge.
For hosting, there tons of paid options, I would try using free hosting for now and learning a bit about using an FTP program to upload your data.
Really, unless you have huge skills or opportunity elsewhere, you're starting at the basics of web development which leaves you in no position to try and start a web-based business. After you learn a bit more, maybe then you can decide whether or not you want to keep learning development or if you'd rather hire / recruit a developer.