These will have different sizes though, so it’s only safe to cast when used off the heap and where it’s memory is allocated with the larger variant, right?

I guess my point is that there’s a whole bunch of caveats in regards to safety that need to be considered in your solution.