Finetune LLMs on your own consumer hardware using tools from PyTorch and Hugging Face ecosystem
Open link in next tab
Finetune LLMs on your own consumer hardware using tools from PyTorch and Hugging Face ecosystem
https://pytorch.org/blog/finetune-llms/
We demonstrate how to finetune a 7B parameter model on a typical consumer GPU (NVIDIA T4 16GB) with LoRA and tools from the PyTorch and Hugging Face ecosystem with complete reproducible Google Colab notebook.