these things are extremely hard to quantify which is why there are explicit lists of "prohibited substances" where the line is drawn more or less arbitrarily. my personal opinion is with the exception of artificial hormones everything else should be allowed.
and when it does come to 'roids and hgh (which btw are demonized beyond any reason) - I like the way powerlifting federations address it - as an athlete you can compete in a tested (which still of course doesn't guarantee the athletes to be "clean") or "untested" federation where anything goes.