People would notice. There needs to be meat in there so customers can worry about food poisoning and complain that it isn't cooked exactly the right amount, regardless of how it is cooked. It is part of the burger tradition.