Whether it's a scheduled or unscheduled interview, people generally want to speak honestly with you - they just might not feel like they have permission to do so, or feel that airing the company's dirty laundry would be inappropriate. In my experience, it can be hard to get people to initially admit things aren't perfect, but once they've done so, the floodgates open.
I tend to ask things like "so, how would you rate working here on a scale of one to ten?" Unless they're absolutely delighted with their workplace, most people respond with an eight or a nine, which doesn't mean anything - you'll get an eight or nine if the company's pretty great, and you'll get an eight or nine if the company's a total dumpster fire. But then you can say "A nine? Why not a ten? What would make your experience here a ten?" This doesn't always work, but at this point the interviewee figures they've already admitted the company isn't 100% ideal and I've usually gotten an unvarnished opinion.