> after several attempts to cancel the contract, I cancelled the direct debit.

They did do that.

But, the issue is if it accumulates without a resolution, it'll reflect badly on your credit score.