This notebook is designed to use a pretrained transformers model and fine-tune it on a classification task. The focus of this tutorial will be on the code itself and how to adjust it to your needs.This notebook is using the AutoClasses from transformer by Hugging Face functionality. This functionality can guess a model’s configuration, tokenizer and … [Read more...] about Fine-tune Transformers in PyTorch Using Hugging Face Transformers
Technical Guide
Pretrain Transformers Models in PyTorch Using Hugging Face Transformers
This notebook is used to pretrain transformers models using Hugging Face on your own custom dataset.What do I mean by pretrain transformers? The definition of pretraining is to train in advance. That is exactly what I mean! Train a transformer model to use it as a pretrained transformers model which can be used to fine-tune it on a specific … [Read more...] about Pretrain Transformers Models in PyTorch Using Hugging Face Transformers
From Text to Knowledge: The Information Extraction Pipeline
I am thrilled to present my latest project I have been working on. In this blog post, I will present my implementation of an information extraction data pipeline, following my passion for combining natural language processing and knowledge graphs. Later on, I will also explain why I see the combination of NLP and graphs as one of the paths to explainable AI.If this in-depth … [Read more...] about From Text to Knowledge: The Information Extraction Pipeline
Why Is Object Detection So Messy?
Those working with Neural Networks know how complicated Object Detection techniques can be. It is no wonder there is no straight forward resource for training them. You are always required to convert your data to a COCO-like JSON or some other unwanted format. It is never a plug and play experience. Moreover, no diagram thoroughly explains Faster R-CNN or YOLO as there is for … [Read more...] about Why Is Object Detection So Messy?
Top Applications of Graph Neural Networks 2021
At the beginning of the year, I have a feeling that Graph Neural Nets (GNNs) became a buzzword. As a researcher in this field, I feel a little bit proud (at least not ashamed) to say that I work on this. It was not always the case: three years ago when I was talking to my peers, who got busy working on GANs and Transformers, the general impression that they got on me was that I … [Read more...] about Top Applications of Graph Neural Networks 2021
Time Series Forecasting with Deep Learning and Attention Mechanism
This is an overview of the architecture and the implementation details of the most important Deep Learning algorithms for Time Series Forecasting.This article was originally published on Towards Data Science and re-published to TOPBOTS with permission from the author.MotivationTime Series Forecasting has always been a very important area of research in many domains … [Read more...] about Time Series Forecasting with Deep Learning and Attention Mechanism
Time Series Classification with Deep Learning
This is an overview of the architecture and the implementation details of the most important Deep Learning algorithms for Time Series Classification.This article was originally published on Towards Data Science and re-published to TOPBOTS with permission from the author.Why Time Series Classification?First of all it’s important to underline why this … [Read more...] about Time Series Classification with Deep Learning
Transformers in Computer Vision
Transformer architecture has achieved state-of-the-art results in many NLP (Natural Language Processing) tasks. One of the main breakthroughs with the Transformer model could be the powerful GPT-3 released in the middle of the year, which has been awarded Best Paper at NeurIPS2020.In Computer Vision, CNNs have become the dominant models for vision tasks … [Read more...] about Transformers in Computer Vision
Building a Complete AI Based Search Engine with Elasticsearch, Kubeflow and Katib
Building search systems is hard. Preparing them to work with machine learning is really hard. Developing a complete search engine framework integrated with AI is really really hard.So let’s make one. ✌️In this post, we’ll build a search engine from scratch and discuss on how to further optimize results by adding a machine learning layer using Kubeflow and Katib. This … [Read more...] about Building a Complete AI Based Search Engine with Elasticsearch, Kubeflow and Katib
Linguistics Wisdom of NLP Models
This article is authored by Keyur Faldu and Dr. Amit Sheth. This article elaborates on a niche aspect of the broader cover story on “Rise of Modern NLP and the Need of Interpretability!”At Embibe, we focus on developing interpretable and explainable Deep Learning systems, and we survey the current state of the art techniques to answer … [Read more...] about Linguistics Wisdom of NLP Models