There's a large number of applications which cannot be done in an FPGA, for instance any complex GHz-clocked digital circuit, or many analog circuits.

Not if you want to put it somewhere small like a satellite or bunch of other things.