Please call your state Assemblymember and Senator about SB 827 and 828, which will allow this to happen. They are certain to be contentious bills. You can find them here: https://sankarravi.github.io/yimbyscorecard/
Caltrain capacity increase is on the way in 2-3 years thanks to electrification and a new fleet of trains.