Whilst the smell can be good in the sort term, over time, it can actually work against you. Trying to go to sleep with the delicious smell of baking bread through your sheets? Good luck with that :) Also, waking up first thing in the morning with the smell of last night's curry still in the air? Not the best.
If you burn milk or something else on the stove? Best leave the windows open and rent a hotel room to stay in for a few days!
Some delicious foods smell terrible during cooking, or even emit slightly dangerous fumes during cooking, like dishes that contain a lot of chilis (the source of pepper spray).