That's an excellent point. It seems like youtube-dl may have started as a tool primarily used for ripping music off YouTube, but it has grown into a tool that is used for so much more than that today (offline viewing of content, backups of freely licensed material, fair use such as extracting clips from videos, etc).
Given that no one is getting sued over this, at least not yet, perhaps it makes sense to not fight this and simply allow youtube-dl as it stands to be pulled and re-imagined as a new piece of software that is explicitly focused on the positive and legal use cases. If RIAA still wants to go after that software, the case against it would be far weaker than the current product that has "YouTube" in the name and explicitly references ripping copyrighted music in its source code.