My understanding is that a portion of the remaining 95% are responsible for turning genes and whole chains of them on and off or something in between.
There is no place in the physical world where this control could come from.
The factors that influence are hugely complex and very hard to separate. Just because we do not understand how certain factors interact and influence our behavior doesn't mean we have control.