You might want to look at:

https://unsloth.ai/docs/get-started/fine-tuning-llms-guide