If I understood the system correctly, at that point mining would become much less profitable so a lot of miners would stop their operations. In that case, difficulty would automatically decrease at the same rate as miners quit, and at some point it would become somehow profitable for the remaining miners to subsist on transaction fees.