You don't want it too low, because then quality becomes meaningless. You do want to give good results to good teams. But there is also don't want it to be perfect - you want some unpredictability in sports. You don't want every match to be a foregone conclusion, and you want every supporter to be able to have some reasonable hope.
There is some data suggesting that one of the reasons that English football is popular is because it's low scoring. This increases the chance that random variation gives an "incorrect" result. In this hypothesis, unpredictability adds excitement and builds popularity.
The NFL achieves similar results a different way - various forms of consistency and negative feedback (salary cap, draft order, schedule) to keep teams very close in ability. This means that small differences like a game plan for a particular week can regularly affect results, and keeps predictability low.
The England game a couple of nights ago. On paper England were better before hand, but Italy were winning until the last minute of injury time. Some England fans had already left the stadium, then in goes the goal, then extra time, then just as it looks like another horrendous penalty shootout there's a foul in the box and England take it, then the goalie stops it, but then it goes in.
Certainly a rollercoaster for both sets of fans.
It comes up again and again, and is a culture clash that is not limited to but particularly prevalent between US and European perspectives.
US sports tend to have less meaningful "regular" seasons, which just seed "play-offs", which themselves often have "Best of X series".
All of that is designed to maximise the chance that the "winner" and the "best team" are aligned.
Meanwhile in UK competitions, an entire yearly competition can be decided by a bad 90 minutes, such as ManU losing to York City, something the fans of both sides likely still remember 30 or so years later.
This argument frequently plays out in e-sports, which still try to find a good balance between the two, with the "best players should win" crowd wanting anti-climatic double-elimination, and the "Let's have more meaningful games" crown preferring single elimination.
"Competitions should be designed to find who the best team is" is a statement that many would agree with, but "Competitions should provide excitement and allow for upsets" is one I think is just as important, if not more so.
Another similar culture-clash is the concept of relegation versus franchising, as well as the concept of "drafting" in a (failed?) attempt to even out the competition.
In the meantime the NBA has had 7 different champions the last 7 years.
Except if you look at the NFL - the most popular sport in the US by far - the playoffs are "Best of 1". The NFL also enforces very close parity which gives a lot of unpredictability. You combine those and you get a lot of upsets.
Perhaps a neural network can be trained on a lot more data to make predictions for each match, and I imagine who gamble a lot have probably done things like this already. But then you don't have a number to optimize.
You can compare it to how it is done in medicine. Imagine a match between a drug and migraine. Would we only do a single test to determine if the drug "wins" against migraine? Of course not. We do many tests and determine a p-value. We can do the same thing in soccer.
Now, of course we cannot do this in a real tournament (it would take too long), but we can draw conclusions from such a test, or several such tests.
What is really interesting and far more worth studying is that there are some very fun outliers - clubs like Bodø/Glimt who have a miniscule annual budget but have overperformed in European competition in recent years. They reached the semi-finals of the Europa League - beating Lazio, Olympiacos, Porto along the way - and in previous years have had similarly deep runs where they battered Roma 6-1 and beat Besiktas and Celtic both home and away. All of the teams I mentioned Bodo/Glimr defeating will have an annual budget that is 10 time theirs (or more) and will frequently make high profile international signings, while Bodo spend frugally and have a predominantly (if not all) domestic squad.
I mentioned Manchester United and Tottenham - they're also outliers worth studying, but in another way. They were both utterly woeful in the league last season despite having astronomical budgets.
If you can crack what causes a Bodø/Glimt, a Manchester United or a Tottenham then you'd be a very valuable addition to the backroom staff of any football club with a desire to punch above their weight...
If heads and tails play many games against each other, then the probability for tails to win the overall "tournament" goes to 1. But football is a sport of relatively few games in cup tournaments and low scores (this relatively high variance). This is very conducive to upsets even if we assume perfectly independent probabilities.
Compare to Basketball play offs, with best of 7 Series and on the order of 100 "goals" per game.
That's maybe why in football the league title is more prestigious than the cups, while in basketball the regular season is not considered anywhere near as important as the play offs.
Tell that to supporters of Scottish Cup Winners 2024/25 Aberdeen FC (I am a supporter of Scottish Cup Winners 2024/25 Aberdeen FC) :D