That's exactly what I've been doing for years. I also gave it a custom ringtone that's 4 seconds of silence and turned vibration off, so unless I'm actually doing something with my phone, or else listening to music, I don't notice the interruption.
The issue is that nowadays, I rarely get spam from the same numbers multiple times. They just generate a new fake number if the first one didn't get a response.