This is not always true anymore. Many modern Samsung TVs (and I am sure some other popular brands) have a standby update option, which would imply it is actually "always on".

Ideally, it is only checking for the latest firmware version while you think it's off, but almost certainly it is doing other nefarious things you have zero visibility into.