Funnily enough in computer science-land the often used model for transformsers corresponds to (heavily compressed) star-free languages, languages without counters, that specifically can't count things, like opening parentheses. This is rather theoretical though, because of the size of constants involved.