Be sure that you select GPT-4 from the drop down list of models. For each new chat, it reverts back to default GPT-3.5.