A 180b Falcon model very recently came out https://huggingface.co/tiiuae/falcon-180B A finetune of this might be competitive, but I haven't tried it.
Reply on news.ycombinator.com