Війти
  • 👁️ 30.6 тыс
  • 📅 1 год назад

Fine-Tuning Local Models with LoRA in Python (Theory & Code)

In this video, we learn how to fine-tune open source models locally on our machine, using LoRA (Low-Rank Adaptation) and the peft package. Code: %20Fine-Tuning LoRA Paper: ◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾ 📚 Programming Books & Merch 📚 🐍 The Python Bible Book: 💻 The Algorithm Bible Book: 👕 Programming Merch: 💼 Services 💼 💻 Freelancing & Tutoring: 🖥️ Setup & Gear 🖥️: 🌐 Social Media & Contact 🌐 📱 Website: 📷 Instagram: 🐦 Twitter: 🤵 LinkedIn: 📁 GitHub: 🎙 Discord: Timestamps: (0:00) Intro (0:53) Theory & Mathematics (14:44) Fine-Tuning on Math Problems (33:54) Evaluation on Math Problems (48:14) Fine-Tuning on Custom Data (51:33) Evaluation on Custom Data (56:30) Outro