Here are a couple of many posts on the topic:
- https://gronskiy.com/posts/glide-ratio-lift-to-drag-and-weig...
NB/ spherical cows are unable to glide in a vacuum.
I guess another thing worth noting is that "glide ratio" isn't the same as "gliding" in the "flying a glider" context.
The space shuttle is probably the most famous glider, and was described as "a flying brick" and getting it to the ground at the right spot was very much a matter of glide ratio. Worth noting the space shuttle's speeds started off as hypersonic.
By comparison, a typical glider's built to be able to take advantage of air currents to regain altitude, and I'm not sure how weight affects that.
You can glide faster with the same L/D, so that might be worth it if you try to optimize for speed.
The minimum speed, at which the critical aoa is reached, increases. And therefore the take off and landing speeds.
It does sound unlikely, and it's not like the comment is saying "no f'ing way!!" It's about as polite a way to say "that's weird" as anything.