If you're already 100 meters out, and there are some waves, are you really able to tell whether you're moving away from the shore or not?
You can feel it easily if you can touch or swim down to the bottom. Also, it's often possible to see where the sand bars and reefs that are next to the rip are located either by seeing the color of the ocean floor or by seeing the waves breaking; get behind those and you'll be out of the rip.