Yes there are protein language models (e.g. [1]), and since DNA encodes proteins, they are effectively DNA language models. Its a hot area of work feeding drug design.

[1] https://www.nature.com/articles/s41587-024-02123-4