To be honest, your post is a bit of a mess in both what you are doing (and have done) and what you are seeking. You clearly have some skills since you are getting paid to be remote and work on technical projects. I would consider taking a step back and figuring out a way to package that.
Next, what sort of external engagement do you want? I think Meetups are great. I'd also look things like Super Happy Dev House and similar events to meet with other people across a mix of interests / skillsets.
Most importantly - what do you want to do / achieve? You have a job paying you, where you feel like you need to grow, but they are letting you be remote. Keep that until you grow more. Those saying join a startup are bat shit stupid. Startups are a walled cage to deliver on the goal of the company and investors. They are great for learning and opportunities for growth, but you need to first narrow down what you want to work on. And most importantly, do not give up that remote option you currently have.
And, honestly, do not idolize the "brain power of the country". There are many in Silicon Valley that will push others under the bus to maximize total comp/etc. Look for those wanting to build and discuss ideas not just push a particular thing.
Good luck. But also, I don't know your age, it sounds like you are in your early 20s, make sure to allow time for you and your GF in addition to your working hours.
If you see a startup saying "we work hard, we play hard, we are a family" RUN THE FUCK AWAY. They just want cheap labor and all your time. I've been to multiple YC "work for a startup" days where companies say this and ... people there were not happy unless they had no GF/other life.
Edit: Also consider looking up Hacker Dojo in Mountain View and events there.