I found this blog post really helpful in explaining the difference:

https://shreevatsa.wordpress.com/2008/03/30/zshbash-startup-...

It references this blog post:

https://meta.ath0.com/2007/10/23/cleaning-up-bash-customizat...