As someone who grows their own jalapenos:

My plants produce extremely mild peppers...

So either the seeds I got were already bred to be mild or maybe there's something else going on there :)

My habaneros are spicy as ever though, so it can't be exclusively be environmental.