This is a common misconception.
1) reducing electricity consumption will reduce use of fossil fuels in power stations (in most parts of the world). Burning fuel in your own home bypasses the inefficient conversion to electricity.
2) if you are going to heat your home with electricity you can be more than “100% efficient” by using a heat pump, so you still wouldn’t want to do it with light bulbs and TVs.