Correct, the seeds themselves are inert, the latex surrounding the seeds is what contains the opium.