The GPT-4 in Bing Chat was fine-tuned by Microsoft themselves, which might its initially unhinged behavior. Only the ChatGPT+ GPT-4 was fine-tuned by OpenAI. Microsoft apparently just got the base model, and they have not as much know how regarding fine-tuning.