Wear to the road isn't the only consideration. If there's no separate bicycle path, they take up space on the road and slow down traffic. Cyclists should pay for the privilege of sharing the road with more efficient vehicles.
Moreover, cyclists don’t cause congestion; motorists do. The congestion + noise + safety issues mean motorists are causing orders of magnitudes more negative externalities than any other transportation methods.