Within the limits of the chemistry one could get to work I see no a priori reason why something other than amino-acids (the building blocks of proteins) couldn't be attached to the tRNAs.
Proteins have the additional very valuable property of being essentially self-assembling - the 3D structures or proteins form inherently from their linear sequence of amino acids. That is one of the key reasons why a linear genetic code works to produce all the many varied proteins in living things.