UPI works on USSD[1]. You need a phone but not necessarily a smartphone.

[1] https://www.npci.org.in/what-we-do/99/product-overview