It is true that if mining revenues fall, less profitable miners will drop off, lowering the difficulty, eventually reaching an equilibrium where some population of miners continue to mine.
The big question is: Will the amount of hashpower willing to mine for only transaction fees be enough to secure the network against 51% attacks?