Colab Notebook for finetuning Gemma 2 2B IT model

Here's a free Colab notebook to fine-tune Gemma 2 2B-it model on MonsterAPI.ai

Gemma 2 2B from @Google @GoogleDeepMind is quite an interesting model as it's only 2 billion parameters in size and is able to beat a variant of GPT 3.5 Turbo. That's not a small feat. If a base model is good at majority of tasks then fine-tuning it for domain specific use-case provides a massive boost up.

And with Monster Tuner, fine-tuning LLMs like Gemma 2 2B is just a couple of clicks and the tuner comes auto-integrated with optimized frameworks like Unsloth, SDPA and FA 2 to fasten up the token processing.

This notebook has a complete workflow where it also formats the provided dataset to suit the EOS token formatting required by Gemma 2 2B IT model to deliver better fine-tuning results with a complete token distribution chart to help us get better insights about our data.

Get started with fine-tuning Gemma 2 2B on this colab notebook https://colab.research.google.com/drive/1FeFeM1viF6jNJDYgUXf...

Have been looking for something similar. Thanks for sharing.