Portable consoles haven't gone anywhere - Nintendo is releasing a new one in just 10 days!
Other manufacturers may have stopped building them, but that's because (with the exception of Sony's PSP) Nintendo's handhelds are the only ones that have ever really been successful.