TensorFlowSharp has bindings to the C API of TensorFlow, but no implementations of the Python stuff that you really need for training, such as optimizers.
I really want to use F# for training deep learning models, but at this point it doesn't seem feasible, at least not without a lot of hassle compared to using Python.