You also probably want

    :noremap j gj
    :noremap k gk

So j/k operate on "one display line" instead of ignoring wrapping.