Mostly true, but the Norman language isn't 100% the same as French, and the differences affected the development of the English language. For example, if England had been conquered by true French speakers, the words "war" and "cat" would have been something like "guar" and "chat" instead.
In fact, there are a few doublets where we borrowed both the Norman and French versions of a word into English. A good example of this is "warranty" and "guarantee"; the former is Norman, and the latter is French. Another is "cattle" and "chattel"; again, the former is Norman, and the latter is French.