Your definition of conservatism is at odds with reality. Rich people are actively trying to live their lives with minimum effort, so it is hard to argue that they are the most talented. Poor people have a hard time making their freedoms worth anything, and they're not been helped by any conservative. The main problem here is that conservative reasoning is circular: if you're rich you must in some way deserve it (explanations will be made for sure), and if you deserve you need to keep the wealth.