Yeah, if you actually want to heat the house with fire you’ll want an insert or a wood stove. Otherwise most fireplaces in most houses are decorative, and one pays for that decoration with heat loss.
As a kid I lived in homes with both - and a home with a barrel stove - and as an adult with a pellet stove and I don’t remember that being a problem. Net, it was fine?