Use GPU to run FST decoding is not something new. The major challenge is how to run it efficiently when model cannot fit into one GPU. The reason Kaldi still uses CPU for decoding is that with a beefy CPU machine many decoders can run in parallel with just one copy of the model in memory. With enough CPUs, the RTF isn't so bad.