any tips on how to go about fine tuning a model?

I would like to test performance on a particular task. I can probably get around 100 hand trained example prompts -> ideal response

Not sure if this is enough to warrant retraining on top of the base model. or if I should just throw a few examples into the prompt itself.

Also unsure which source download I should start with if I intend to do retraining