This would likely be in violation of several wiretapping laws though (Also, Clubhouse's own ToS).
Think of it this way: it's not a wiretap to record a public speaker.
Even in all party consent states, a clubhouse session might qualify as public speaking and not be subject to any recording restrictions.
Although a wrinkle is a single user in a two-party jurisdiction overrides and all parties would need to be notified, and if you don't know for sure where each end user is, then you're taking a gamble on the legality.