How will you know when you should fall back to manual? There's really no measurement of accuracy that I can think of. If you've reached the point in the algorithm where you know you've incorrectly identified the food it seems like you've already solved the problem.