Proprietary software does nothing as drastic as 'take away your rights'. There is no inherent right to browse source code. At best, you entered into an agreement when you started using it that doesn't grant you as many benefits.
Source code is an oddity, sure, because you can distribute binaries that aren't modifiable and keep the source private yet still have no copyright on anything, but you aren't practicing software freedom. The source code availability is absolutely an extension, but it is no more so one than saying it is unethical to give you a car and never let you see the instruction manual if you wanted to try modding it.