Try telling GPT-4 that the translation is bad, and ask it to proofread the result for a more natural French
This actually gives much better results, and now I think I actually changed my mind and like GPT4 better.
It just needs some commands to follow.
Something like: "Fluently translate this text, from {here} to {there}, while preserving details" seems to be fine for me.
If the style then needs tweaked, then I edit the original command and tweak it to have it start anew: "Fluently translate this text as a peasant baker from Rhode Island in 1810, from {here} to {there}, while preserving details"