The actual difference between the two is quite diminished compared to years past and seems to reduce more to how a collection of computers is used and not what it is.
Saturating a box with 500+ GB GPU RAM is fun. Only our gov users ask us for help on that typically: most of our users are commercial nowadays, but with much smaller/scaled down GPU rigs. I think that'll change as the fintechs keep improving and software gets easier, but they are still not there (outside of niches). Working on it :)
(If you like writing shaders, we are hiring :D )
In addition to the other responses, I like pointing people to this talk[1] by Jeff Hammond for a comprehensive answer to this question (you can skip to the 11:15 timestamp).
[1] https://uchicago.hosted.panopto.com/Panopto/Pages/Embed.aspx...