If that's too ghetto for you, have a look at the M5Stack series. A main unit (ESP32, screen, speaker, TF card reader, in a case with some buttons) costs $35, and the battery module you can stack on is $10. There is even a keyboard and a gameboy-like attachment.
I like the look of the Precursor, but personally the FPGA is a bit off-putting, just because I've never gone down that road.
> if your application does not require a large display and a keyboard, you can simply remove them and replace the bezel with a full-sized circuit board
Just the other day I found out about WiPhone: https://www.kickstarter.com/projects/2103809433/wiphone-a-ph...
The project appears to be in a "limbo" state.