A lot of chairs give poor support for proper posture. Aerons are very good about that in my experience; something with the same profile will probably do you well.
Lean the chair back slightly. Adjust the lumbar support (I hope you have one) to support your lower back.
This works for me at me desk and in my vehicle.
Get a lumbar roll. Your upper back shouldn't be in contact with anything.