That surely must be a bit too oversimplified, since that would imply that the beginning of the observable universe had more entropy than the current one (given that it was way hotter than the present)
But, coming from a high entropy state does not fit with the world we see, so we're pretty sure that the past hypothesis is true.
One of the leading theories about the early universe and how it lead to the world we know today, is inflation. In that theory "stuff" is basically created out of nothing, meaning that the early universe was small, hot, and with (relatively) few particles in a specific configuration. The inflation and reheating dramatically increased the entropy. In other words - there was much less stuff, and it needed to be in a particular configuration to expand into the universe as we know it. That is low entropy.
Note: I am not a theoretical physicist, so the above is my layman understanding of the topic.
Additionally, the Big Bang is theorised to have passed through "absolute hot" https://en.wikipedia.org/wiki/Absolute_hot