Do you think you have also gained something from that loneliness? Better abilities for introspection, for example, or some particular thinking patterns that other people seem to lack?
This also gave me a “growth mindset” at an early age. I realized in ~9th grade that I had no idea how to hold a conversation with someone, which forced me to view my social skills as something dynamic which could be improved. People are now very surprised to hear I was homeschooled, so I think my efforts to improve my communication skills have born fruit.
I can only speculate on how much the rest of my current personality was influenced by that experience; either directly, or from secondary effects like reading a lot (in place of socializing) at an early age.
If anyone is seriously considering homeschooling and wants to hear a contrary opinion, please feel free to send me an email :)