It sounds like he barely has any idea what he's talking about...or you two are talking about totally different things. Has this happened before with him? Has he done this to anybody else?
If you can: be diplomatic, take him out for drinks after work one day and have a heart-to-heart. He wields a significant amount of power, and it'd be in your best interest for him to like you alot.
Word substitute accordingly. There's a reason it's a bad idea for candidates to bad-mouth their current employer, and it's the reverse of this situation.