"Kernel development is not supposed to be for everyone, it's hard."
Citation?
Given you've admitted to not working on kernel code, this seems like something you've determined out of reverence for the importance of the kernel, not something grounded in fact.
It's worth noting that the entire Linux project spawned from some "casual" development work by somebody doing it as a hobbyist project.