No, "works without Javascript" is way outdated advice that has nothing to do with accessibility in the modern world. The whole point of ARIA is to make dynamic, JS-driven web UIs accessible.
Good accessible design has benefits for everyone, not only the disabled. For instance, that half of the web breaks when you turn off JavaScript, turned into a security issue when Tor Browser enabled it by default (to not confuse their users with a broken web).
Progressive enhancement and accessibility go hand-in-hand. If not for accessibility reasons, then develop websites with accessible JavaScript for security, SEO/automated access, or progressive enhancement reasons.