I understand how a streaming SQL engine works, but I’m wondering what the real world use cases for this are. Is this more for large scale enterprises?
(Disclaimer: I work for decodable.co, a managed stream processing platform leveraging Flink SQL)
However when using the models for prediction, the data hasn't been ETLed (think: credit modeling). One solution here is to use the same SQL for the ETL and for the online transformation to query the model. It can guarantee the biz logic in the features matches between training and online.