In case with lack of specialized float arrays, the worst that is going to happen is performance degradation. It's not like they are some non-standard extension.
Common Lisp has standard ways to define that code must run on particular implementations that support a certain feature. There is nothing wrong with developing libraries supported by just a few compilers.