Right. Which is why SAQ A-EP was invented -- to prevent merchants from gaining compliance based on the loophole that they are using a js library or offsite link to collect payment.
SAQ A applies when using one's own server infrastructure, and SAQ A-EP applies when using a PAAS.