But but all the leftovers are not necessarily burned down. Some of it is (that's where most pellets come from I believe), some is left in nature and becomes part of soil, some is reused in particle board.

I don't know about the carbon impact of what goes back in nature, some is decomposed by bacteria, some just stay there, some may act as a fertilizer, I don't think it is bad.