Pro Tip: The GRU is a much simpler unit (easier to explain) and usually works better than the LSTM.
TL;DR - For most tasks other than Language modeling GRU is better.
The learning capacity of the LSTM and GRU is proportional to the number of weights, so you need more GRUs to do the job of a given number of LSTMs.
It drives me nuts to see so many tutorials where people do the LSTM because they saw other people do the LSTM when doing the same with the GRU is simpler and better!