A new survey by the Harris Poll reveals that concerns about layoffs and job advancement are pushing many workers back to the office.