You've gotta watch Steve Blank's "The Secret History of Silicon Valley". Goes back to its post-war roots in 40's and 50's. A real gem and quite surprising.
Silicon Valley as a startup hub is much older than PayPal. Indeed, Silicon Valley was a major startup hub (in hardware) before most of the PayPal founders were born.