Unhappy with career, please help.
First, some context: I work for a big company on a popular online service. I have a masters degree and my field is machine learning. I'm smarter than all my peers at work.
I started off with a my-code-is-going-to-change-the-world attitude. I remember my heart racing the first time I was looking at results of my code processing petabytes of data. Then, slowly my smart, idealistic, I-will-create-perfect-AI self started bumping into reality. Rather than math/ML challenges, I was faced with problems like technical debt, missed deadlines, unmet expectations, unhealthy peer competition, endless frog-eating, fragmented days, daily scrums... to cut a long story short, it has been a long time since I did anything that I'm proud of.
And I have been in the company for more than 7 years now. Yes, I should just leave and go to a better place - that much is obvious. But here's the thing - I don't expect it to be better anywhere else. I don't want to join another big company and slowly nudge some KPIs upwards. I want to solve hard problems. Problems not solved yet. Problems that are important and that matter. The answer that I'm going to get maybe "go join a startup". But I'm an immigrant on work visa and this is risky. Also, I have a pretty demanding family life and I'm not sure I'd be able to put it the long hours.
After being frustrated for a long time and some failed attempts to change the situation, I have decided to go all-in and explore all my options aggressively. I cannot afford to not change things any more. I plan to interview a lot.
I could use the advice of people on HN. Have you had similar experiences? How did you get out of it? Am I being too pessimistic about potential opportunities? What are the things I should look out for before accepting my next offer? Is there hope for me?