Those are called GPUs! Or, if you like, GPGPUs.
Readily available in The Cloud(TM) and everything.
Readily available in The Cloud(TM) and everything.
Either way still not close to 1000 independent cores.
if(blockIdx.x == 0) doThing1(); else if(blockIdx.x == 1) doThing2(); ...
etc., and the doThings could run at the same time, even on the same SM. Not super practical but it's allowed.