I think you're mistaking the term model for a replica. You don't need a replica, but you do need a model for your relevant tasks.
If the heater needs 30 mins to warm up before it starts pumping heat, you'll need to model that. If it overheats after running for 3hrs straight you'll need to model that too. You don't need every molecule of the physical item replicated but you do need to model all of the relevant behaviors.
I can think of a couple of places where it could have avoided accidents (one tragic and one expensive.) The 1974 DC10 crash in Paris was supposed to be impossible because the airplane could not be pressurized unless the cargo door was properly latched, but the mechanism depended on the position of the handle rather than the latching pins. At Three Mile Island, the operators were trained to use the pressurizer water level as a primary indicator of the state of the system, and turned off the emergency cooling feed as a consequence.
~W. Ross Ashby "Introduction to Cybernetics", http://pespmc1.vub.ac.be/ASHBBOOK.html
I worked at a place that had some sort of Just-in-Time heater for the sinks in the bathroom. One of them oscillated too hot too cold too hot too cold, etc. Eventually someone adjusted some setting and it worked properly. That setting was (part of) the "model" of the heater+sink+bathroom system.
For the latter, there's an entire field devoted to this problem called "system identification", one popular textbook seems to be online nowadays at http://user.it.uu.se/~ts/sysidbook.pdf
https://medium.com/@jonathan_hui/rl-model-based-reinforcemen...