Wow, I completely forgot about that fact. So the play triangle was an arrow saying "tape is rolling in this direction" and fast-forward and reverse double triangles were "tape is rolling fast" in the respective directions.
Did these buttons first show up on cassette players? The reel-to-reels I can think of had multi-position switches.