This is already something that e.g. Claude 3.7 Sonnet appears to be able to do very well, with the added benefit of explaining why if you let it -- what is the benefit of this model?:

> "Sometimes flu vaccines don't work; therefore vaccines are useless." - Hasty generalization

> "Every time I wash my car, it rains. Me washing my car has a definite effect on the weather." - Post hoc, ergo propter hoc

> "Everyone should like coffee: 95% of teachers do!" - Appeal to popularity and hasty generalization

> "I don't want to give up my car, so I don't think I can support fighting climate change." - False dilemma