Yes I really did try to answer as soon as possible. Why would I not? Because it might give me a 'bad' evaluation? Why would I care when I don't even feel that it's valid?
In fact, attempting to answer quickly is what lead me to feel it was largely a trick, because it switched up locations of gender after consistent streaks of a given gender (or other metric) being presented solely in one place. Several times I'd be just about to click something and then think "Hey, what the heck? Why did it suddenly move the answer?". This represents a confounding variable in the experiment, because it no longer strictly measures beliefs, but instead measures a mixture of beliefs and motor ability (ability to react quickly to the changing locations of answers), so the test can't determine if an answer was due to belief or motor ability.