Depends on the path right? If its backend/systems related yes it may require you to write actual code and the person may still feel out of his depth. But there are areas in front-end for example where writing testcafe/cypress stuff is more like "go here, click on the thing, then click here", which doesn't need much more than basic coding ability.