You could use some off the shelf components like an ESP8266 or ESP32 module to dramatically reduce your cost. A hand full a discrete components, an electret microphone, auto gain amplifier, and a voltage regulator aren't going to set you back more than $10. A custom PCB is going to be $5 per unit max. The BOM is easily under $20 for a limited run of 10 to 20 units.
The most expensive things are going to be the enclosure and assembly. If you find an off the self enclosure then your costs drop considerably.
You could have a working prototype cobbled together in a day.