In most places I know of, you will not pass inspection for new circuits if you don't have a certain amount of headroom in your panel, this is defined in the building code, and there will be no way to argue your way past it.