Unfortunately, they're not doing a good job at deleting them. If you press the "Delete Account" button, all it does is anonymize your profile, and leaves all of your messages intact. One of the reasons I avoid using Discord whenever possible.
edit:typo
Delete is useful, but it shouldn't change what you're willing to send online because delete doesn't time travel and unsend the message.