Setback laws are usually about not building a structure too close to a lot line. On the front, a minimal setback keeps the street from becoming a canyon. Larger setbacks are more of a look and feel thing for a neighborhood. Front setbacks may also be governed by adjacent houses to encourage all the fronts to line up. It’s tidier that way.