Or you can underthink it. It's side-effect free, takes no arguments, and is terminating, so it can be optimized perfectly for speed:
#!/bin/cat
1
2
fizz
4
buzz
6
… 98
fizz
buzz