"brick grey ancient barn" is grammatically correct if you assume "brick grey" is a color, but of course that's probably not what it's supposed to mean.
A "leather horse saddle" and a "horse leather saddle" are very different things, and no native English speaker would mix them up. You know which they mean.