Even if they didn't vote, Trump and Pence get fired at 12pm on Jan 20th, and Pelosi becomes president.

The only way for Trump to remain president past 12pm Jan 20th is for the joint session to declare him president.