Stephen Colbert hosted a public access show the day after his Late Show run ended.