They always did something; the Turbo button was switching the CPU frequency on older PC's that ran software with no speed auto-dectection and adjustment. On IBM PC XT the turbo button was switching between 4.77 and 9.54MHz, on AT it was 8-12 or ever 16 MHz. They were needed on faster computers because some games were otherwise unplayable at the higher frequency.
You may have had a turbo button on a PC case that was not connected to anything, that is a different story. If you put a 486 in a case from a XT the turbo button "not working" is your fault only.