Hacker News Reader

NVIDIA Tesla P100 has 21 TeraFLOPS of FP16 performance by their words. So they got 8 chips there.

Yep, they showed a diagram of how it fits together: http://i.imgur.com/xk1daFG.jpg

I wish that made that information more accessible. I wasn't able to find it on the site and it was all I really cared about.

Ah, half-floats. That explains it. Still pretty high but realistic at least.