Expensive pre-processing is hardly a problem: Generate representations and features once and store to drive. Use a feature/vector database if you feel fancy.

For deep learning, out-of-core instance loading by means of batching is the standard approach. Sure you sometimes have to tune batch size and learning rate for optimal learning, but it's a solved issue.