Some HN community member recently plugged his side project in another thread and it seems quite fitting here: https://pausbox.com/

It's a configurable phone enclosure that physically separates you from your phone but lets important calls get through.

There are surely cheaper and probably more efficient ways to address OP's question but I might throw it in here anyways since it's sufficiently related.