> is everything just function application all the way down?

No non-toy programming language is actually implemented this way, but you can do it if you really want: SK combinator calculus is an example.