you could certainly encode data into an transformer using custom tokens and fine-tune but that's not trivial.
Im sure, there are ton of other options by applying whatever "mega-tech", but if the result is only slightly better while having much more costs (and complexity!), for me its not worth (as i'm not a company, but an individual invstor)