They distribute a 32-bit .exe of APL that should run under Cygwin. ftp://ftp.gnu.org/gnu/apl/apl.exe
I just hope that someone outside of GNU APL with the ability to make a normal Windows install package isn't as enamored with Windows barriers and would like to see APL proceed. And I hope the GNU license restrictions allow for that.