Astronomers may have identified what may be the smallest known star
slate.com
slate.com
The good thing about astronomy is that there's always something impressive.
This will take 'a while' for rather large values of 'a while'. (10^33 years according to the latest info...)
So stars will not go after ordinary matter has gone but the other way around, just like ordinary matter (just hydrogen and helium, actually everything else we have came out of other stars) preceded star formation.
The embers of the universe will take a long time to stop glowing.