The hands do not just need to be agile to manipulate objects, they also need to have an opposable finger.
Racoons' "hands" (more like paws) do not have any.
Racoons' "hands" (more like paws) do not have any.
I feel opposable thumbs tend to be brought up on the logic of "this is one of many features unique to humans, therefore it must be related to the important feature unique to humans, which is intelligence". In this case it's not even unique to humans: all Old World monkeys and apes have opposable thumbs to one degree or another.