I wonder if this attitude was a thing when CS was first introduced as a major. At the time it must have looked like someone basically took a tiny part of electrical engineering and made it into it's own field of study.
Historically, it was as likely to be part of the math department as it was to be part of electrical engineering. In part, this was because at the time electrical engineering was much more about analog circuits, power systems, etc.