[1] https://www.google.com/search?q=Elasmotherium+sibiricum&tbm=...
[1] https://www.google.com/search?q=Elasmotherium+sibiricum&tbm=...
That said I fully get how a mammoth / rhino could inspire and may actually be the real root of the folk story. While Subject Matter Experts[0] can be wrong the folk story now has its own definition[1] and physical evidence[2].
Sidenote: Now I know why Pratchett likes footnotes.
--
[0] 8 year old who has read everything about unicorns
[1] reference for the horselike resemblance https://en.wikipedia.org/wiki/Unicorn
[2] relevant toys and pictures presented as proof
[3] like a lot of political "facts"
[4] someone authoritatively says so
[5] or true enough, see [3], to meet perceptual expectations[1].
[6] rhinos can be ridden if you're suitably enthusiastic and are also able to run faster. Mammoths with horns were probably similar. This is logically not much different to how wild unicorns[1] would be so I'd not discount too much. The riding aspect is therefore a weak disqualifier.