GPT-4 is significantly better than GPT-3.5-turbo. Do not use GPT-3.5-turbo outputs as your benchmark for the utility of the more advanced models! :) Especially when used for LLM Agents, or any kind of harder question.