Hacker News Reader

Comment by panabee | Hacker News Reader

Google Cloud Functions is awesome, except for the 10 MB file limit and lack of GPU support, making it pretty much unusable for compute-heavy ML models.

If Google could ever lift these restrictions, GCF would be perfect for auto-scaling ML models.

View on HN

You got the wrong idea about serverless if you think it should have a GPU attached to run your ML dataset.

Generally speaking, you want it to do something simple and quickly

GPU can also help with inference. I think running a cloud function to evaluate an input on a pretrained model seems like a good use case.

For inference, not training. Sorry for the confusion.

Also the request timeout needs to be raised.

I have a few workloads that execute only very infrequently, which makes them suitable for functions, except when they do run they sometimes exceed the 10 minute timeout.

Cloud Run has 1 hour timeout in Beta https://cloud.google.com/run/docs/configuring/request-timeou...

What do you mean by file limit? I made a GCF service to handle 400mb+ video files

Not OP, but perhaps he meant size of data passed directly in a request which is indeed 10MB: https://cloud.google.com/functions/quotas

I don't think I had any issues loading larger files from Storage either.

Yes, data passed directly into a request. Files loaded from storage are exempt from the limit.

Data passed directly into a request is limited to 10 MB, but you can use storage to load larger files.

Reply on news.ycombinator.com