More or less AMD CUDA: a collection of compilers, tools, and libraries. The main difference is that NVIDIA markets CUDA strongly based on CUDA C++. You know the way you write CUDA is through nvcc and the language it accepts, unless you turn out to have exotic needs. Instead, AMD just provides a whole bunch of various things with fuzzy documentation, and lets you to pick whatever you like (although I'm not quite sure how you're supposed to know what you like).
Will this help any on getting acceleration for Tensorflow?
Yes, there is supposedly Tensorflow support in ROCm. I have never used it, so I cannot say how well it works.
Just don't expect it to be as good as Tensorflow on CUDA.
What makes you say that? It works perfectly fine and so far I haven't encountered anything I couldn't do with tensorflow-rocm that should be doable with Tensorflow on Nvidia
Well they have decided to put the most important information at the bottom of the readme...