Is not using the shipping address for any other reason than shipping an order really that much more effort?
Sure, protecting that information is more effort, but you should be doing that already, right? not just from a GDPR perspective but a business perspective too - if a competitor can get a list of all your clients and send them brochures with 10% discount on your prices, you'll close down pretty quick.