Purely anecdotal of course, but as a person that struggles to do sports consistently: for me, the thing you are saying this does not prove is absolutely correct. As far as my body is concerned, not doing any sports for months will get me way better sleep then when I do any amount of exercise after 6pm.
As a matter of fact, if I do exercise (cardio) that late, I can guarantee that I will not be able to fall asleep before 1-3 am. Even if I do it consistently for a few weeks.
Obviously just an observation of my own body. But it's the reason why I will no longer even attempt to do anything remotely like cardio post 4pm