Here’s almond milk referenced in a recipe in 1410:
“For to make blomanger. Nym rys & lese hem & washe hem clene, & do þereto god almande mylke & seþ hem tyl þey al tobrest; & þan lat hem kele.”
People have used the word milk to refer to some plant products for too long for this to confuse people now.