Thank you! I'd seen people remove some of the SH coefficients while still getting reflections, and I couldn't understand how that worked. The old tricks sometimes really are the best tricks.
Thank you! I'd seen people remove some of the SH coefficients while still getting reflections, and I couldn't understand how that worked. The old tricks sometimes really are the best tricks.
Although now that I think about it, there's no real reason to not just make the Gaussians invisible from behind.
But since the splats aren't a surface, they don't exactly have a "behind". They might render from every angle on purpose.
Spherical Harmonics apply to the whole sphere, splats can learn a SH color for their "behind". But by definition there is no data for these (no camera to tell what the color is). Nothing is preventing current pipelines to define that the opposite direction (splat looking at the camera) has a special color (black, zero-alpha, blend of blurred splats between camera and splat, etc); or to regularize all splats so that there is some amount of an "undefined" transparent component to be applied where camera won't define the SH.
Wouldn't you need to know that there is no other camera view from the opposite direction? (sorry if dumb question, haven't actually looked at how GS are generated from input data)
However in most cases this will simply cut off as soon as you view a surface from the other side, so it kind of makes sense to add some special handling for that scenario. Especially since it can be hard to properly fit a discontinuity like that.
As it currently stands I imagine the reflection trick would be unable to work if you had a camera view from the other side, which is not ideal.