What is there to be worried about? scikit-learn is a solid, tested implementation of most machine learning algorithms. If you're doing work in Python and want to run your data through a standard ML algorithm, and the algo is implemented by scikit-learn, then just use scikit-learn. If it isn't implemented by scikit-learn, you find some other implementation or implement it yourself.
Experts use all sorts of things: MATLAB, R, Python (with scikit-learn), etc.