Yes, however the raycasting is drawing pixel by pixel. That part is not hardware accelerated, and that is the expensive part. That is that part that shaders speedup a lot, by delegating a lot of the work to the GPU.
Just compare with this pure fragment shader demo: https://www.shadertoy.com/view/MsS3W3