My original thought was shot down when I read this:
The Pipeline API is not a data or stream processing engine. The Pipeline API is not a data or stream processing engine.On the other hand, the Pipeline API is task oriented. Developers use it with a procedural approach. The focus is on parameter and return value passing and scheduling. It's easy to reuse your existing code in this framework. Think of it as something closer to a parallelizable Bash than a data processing framework.