It's not common, but not unheard of. Nat Friedman and Daniel Gross own a cluster of GPUs that they rent back to their startups for below market rates. They essentially trade GPU time for equity.
Index Ventures has a deal with Oracle to provide GPUs at no cost to their startups (they pay the bill).