You're viewing it from a sympathetic light from the start. While one might argue that domain names are property, the seizure of an access point to an online service means that the seizure can effectively act as an injunction against a business.
Moreover, this is publicly-visible "property". It's like going to your house and turning it into a strip club and putting up a sign saying "We employ minors" (regardless of whether you are a strip club or employ minors). Sure, your house still exists, but the address that it used to be at now showcases something that can damage your reputation irreparably.
So while you might consider the actions legal using an interpretation favorable to law enforcement, if you view it from a different lens of "A harmless business owner's livelihood was suspended without warning by ICE and his reputation untruthfully damaged by said action", then it's clear that some level of legal protection (whether it already exists as a part of due process or not) is missing and that ICE was criminally negligent in its handling of the situation. Of course, this is a favorable viewpoint on the other end of the spectrum, as not everyone whose domain was seized is necessarily a business owner or a highly-trafficked site. However, it is a viewpoint that assumes innocence, rather than guilt, before proven otherwise.