The current pedagogy of Calculus is atrocious, and any method which helps impart the beauty of it without battering the souls of the students is worth pursuing. Feynman's great strength was his disregard for orthodoxy in the search for greater truth. Big-O notation is for more than just profiling the costs of computational algorithms. It is for reasoning about inexact quantities and seeing the greater patterns in the relationships between numbers and functions. Is using Big-O as a method of teaching Calculus better than the current process? Honestly, almost anything would be an improvement.
Math and Calculus are both beautiful and practical. But the current way we teach them completely loses those notions in favor of rote memorization and techniques without context.