How about alignment/ability to answer prompt queries and chain of thought reasoning capabilities?

Without the fine tuning RLHF phase to make it like instructgpt I'm assuming it won't be as good as ChatGPT, is that right?

How hard would it be to fine tune the 65B model on commodity hardware?

Found answer here:

> Out-of-scope use cases LLaMA is a base, or foundational, model. As such, it should not be used on downstream applications without further risk evaluation and mitigation. In particular, our model has not been trained with human feedback, and can thus generate toxic or offensive content, incorrect information or generally unhelpful answers.

https://github.com/facebookresearch/llama/blob/main/MODEL_CA...