My oldest is in Kindergarten and we are homeschooling her. You didn't mention your opinions on religion, but you will find that most of the complete curriculum are made by religious organizations. Although we are moderately religious, we use a completely secular curriculum, The Calvert School. See homeschool.calvertschool.org. We used them largely because they are an "umbrella" program approved by the stte of Maryland(where they are located and where I live.) We are happy with them so far. They are one of the more expensive programs out there but there is a lot of value in the materials they send.
If you are located in a state or school district that makes homeschooling difficult also consider joining the Home School Legal Defense Association. We have not had any problems(our county seems to be okay with homeschooling) but others in our state are not so lucky.