Vigyata.AI
Is this your channel?

Fine-Tuning BERT for Text Classification (w/ Example Code)

69.6K viewsΒ· 1,961 likesΒ· 23:24Β· Oct 17, 2024

πŸ›οΈ Products Mentioned (8)

🀝 Want your team maximizing Claude? I run 1:1 and team AI workshops for companies doing $1M+ per year: https://aibuilder.academy/yt/4QHg8Ix8WWQ In this video, I walk through how to fine-tune BERT (110M parameters) to classify phishing URLs. I first cover key concepts and then share example Python code. Resources: πŸ“° Blog: https://medium.com/towards-data-science/fine-tuning-bert-for-text-classification-a01f89b179fc?sk=1fdd9847fcfa70c772f317d3eeeaec07 πŸŽ₯ Fine-tuning LLMs: https://youtu.be/eC6Hd1hFvos πŸŽ₯ Compressing LLMs: https://youtu.be/FLkUOkeMd5M πŸ’» GitHub Repo: https://github.com/ShawhinT/YouTube-Blog/tree/main/LLMs/model-compression πŸ€— Model: https://huggingface.co/shawhin/bert-phishing-classifier_teacher πŸ’Ώ Dataset: https://huggingface.co/datasets/shawhin/phishing-site-classification References: [1] https://arxiv.org/abs/1810.04805 [2] https://arxiv.org/abs/1511.01432 [3] https://arxiv.org/abs/1801.06146 Intro - 0:00 Fine-tuning - 0:55 BERT - 5:09 Text Classification - 8:39 Example (Motivation) - 9:41 Example Code: Fine-tuning BERT on Phishing URLs - 10:55

🎬 More from Shaw Talebi