You have to prompt it correctly, non-instruction-aligned models don't behave like agent simulators by default.