• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
  • Menu ItemTopbots logo
  • Topics
    • Computer Vision
    • Conversational AI
    • Infrastructure
    • Natural Language Processing
    • HR & Recruiting
    • Marketing
    • Research Summaries
    • Technical Guides
    • Applied AI
  • AI Research
  • Login
TOPBOTS Logo

TOPBOTS

The Best of Applied Artificial Intelligence, Machine Learning, Automation, Bots, Chatbots

George Mihaila

BERT Inner Workings

April 20, 2021 by George Mihaila

BERT explained

I created this notebook to better understand the inner workings of Bert. I followed a lot of tutorials to try to understand the architecture, but I was never able to really understand what was happening under the hood. For me it always helps to see the actual code instead of just simple abstract diagrams that a lot of times don’t match the actual implementation. If you’re like … [Read more...] about BERT Inner Workings

GPT2 For Text Classification Using Hugging Face Transformers

April 15, 2021 by George Mihaila

text classification

This notebook is used to fine-tune GPT2 model for text classification using Hugging Face transformers library on a custom dataset.Hugging Face is very nice to us to include all the functionality needed for GPT2 to be used in classification tasks. Thank you Hugging Face!I wasn’t able to find much information on how to use GPT2 for classification so I … [Read more...] about GPT2 For Text Classification Using Hugging Face Transformers

Fine-tune Transformers in PyTorch Using Hugging Face Transformers

March 4, 2021 by George Mihaila

fine-tune transformers

This notebook is designed to use a pretrained transformers model and fine-tune it on a classification task. The focus of this tutorial will be on the code itself and how to adjust it to your needs.This notebook is using the AutoClasses from transformer by Hugging Face functionality. This functionality can guess a model’s configuration, tokenizer and … [Read more...] about Fine-tune Transformers in PyTorch Using Hugging Face Transformers

Pretrain Transformers Models in PyTorch Using Hugging Face Transformers

March 2, 2021 by George Mihaila

pretrain transfomers

This notebook is used to pretrain transformers models using Hugging Face on your own custom dataset.What do I mean by pretrain transformers? The definition of pretraining is to train in advance. That is exactly what I mean! Train a transformer model to use it as a pretrained transformers model which can be used to fine-tune it on a specific … [Read more...] about Pretrain Transformers Models in PyTorch Using Hugging Face Transformers

Primary Sidebar

Learn Applied AI

We create and source the best content about applied artificial intelligence for business. Be the FIRST to understand and apply technical breakthroughs to your enterprise.

Follow us

  • facebook
  • twitter
  • youtube

POPULAR ARTICLES

10 Leading Language Models For NLP In 2022

NeurIPS 2021 – 10 Papers You Shouldn’t Miss

A Guide To Knowledge Graphs

Why Graph Theory Is Cooler Than You Thought

Top Applications of Graph Neural Networks 2021

Leading AI & Machine Learning Research Trends 2021

More Articles

Topics

  • Bots

  • Brands

  • Business

  • China

  • Commerce

  • Computer Vision

  • Conversational AI

  • Customer Service

  • Cybersecurity

  • Data Science & Engineering

  • Design

  • Education

  • Ethics & Safety

  • Finance

  • Gaming

  • Healthcare

  • HR & Recruiting

  • Infrastructure

  • Leadership & Management

  • Manufacturing

  • Marketing

  • Natural Language Processing

  • Reinforcement Learning

  • Research

  • Retail & CPG

  • Society

  • Technical Guide

  • Technology

Footer

About TOPBOTS

  • Expert Contributors
  • Terms of Service & Privacy Policy
  • Contact TOPBOTS

Copyright © 2022 TOPBOTS