I'm just thrown by your statement. No feature phone I've purchased has had the ability to use WhatsApp, so what are you talking about? Feature phones tend to come with a few preloaded apps, if that, full stop. Many come without the ability to run any apps at all. Maybe some feature phones have access to a app repository and some WhatsApp client could exist there?
Or are you thinking you could have a web interface was if the feature phone includes a basic webbrowser?