Textbooks Are All You Need II: phi-1.5 technical report
"Perhaps achieving ChatGPT’s level of capability at the one billion parameters scale is actually achievable?"
"Perhaps achieving ChatGPT’s level of capability at the one billion parameters scale is actually achievable?"
Right now they're comparing to the 7B Llama 2, which is a shadow of 65B llama2, which is a couple steps off ChatGPT, which is a shadow of GPT4.
I'm still comfy saying yes because there's no reason to doubt it will follow the same logic as "eventually $phone will have the same FLOPS as $desktop"