But if you don't know UX, how can you judge such portfolio? You will be leaning towards pretty show-offy things, but not good UX.
Film critics are usually on the mark and have nowhere near the skill to make films.
If someone 'doesn't know design' in any way whatsoever, and for some reason they want to be responsible for it ... they are in trouble.
I would suggest learning a little bit about at least what's important to the organisation, and finding reference sites as comparatives.