Three or four seems to prove the feasibility.
> hiring - will I be able to find talented people to work on the codebase?
Yes. The people you find who hack Scheme or Common Lisp tend to be very talented. If you want to ramp up to 1000 programmers quickly, yes, you would have trouble getting experienced people. But if you're doing a startup, no sweat. Or so I think so far; watch this space.
> libraries
PLT Scheme and Common Lisp actually have big libraries, though not as huge as Java's. In most cases, though, the equivalent library in Scheme (and CL, too, I imagine) is much better than it's Java counterpart. Find me something in Java that is half so good for parsing HTML as this: http://www.neilvandyke.org/htmlprag/
There are Scheme/Lisp hubs that aren't startup hubs. Salt Lake City would be one. More generally, if everyone in your town uses Java, move.