I think you’re mischaracterizing some part of the opposition with “should have to work”. To my school of UBI skepticism, it’s not at all about Lutheran work ethic as a deontological good.
To clarify: I don’t believe we take care of elderly/disabled/children solely because it’s “the right thing to do”. Instead I believe we do it due to other conditions e.g. “it could be me one day” and “it’s just a few people so we can afford it”. Based on that, I think the stance will change if the conditions change.