I'm confused about the ipython reference, using a notebook for eda or results presentation doesn't have much to do with a data pipeline. I love the idea of being able to use shell scripts to orchestrate data prep and training. There are lots of
curl | grep | awk > .csv
patterns I've used in real life, and having a way to train a model from the command line is a great complement.Currently I would call a python training script from the command line, and do orchestrate everything in bash. I'm not sure why thay is undesirable.