Whatever refracts the light will have to stand up to the beam for long periods of time. Maybe it's a materials science problem.
Just like the electric cables for your water kettle typically don't get hot.
This type of laser carries so much energy that even a tiny fraction of a percent absorption will add up quickly, hence the propensity for injury.