Growing from 0 to 1M users is probably harder than from 1M to 100M.
But if you are in a 1 billion market, your growth rate is impressive and you make data-driven decisions to manage your future growth, then yes, 0 to 1M was harder.
Warren Buffett has a quote for this: "Life is like a snowball. The important thing is finding wet snow and a really long hill". Even if you find wet snow, it's important to look how long the hill really is.
Larry Page uses the toothbrush test: he wants to invest in products that people would use like a toothbrush, twice each day.