Natural language processing is a powerful tool, but in real-world we often come across tasks which suffer from data deficit and poor model generalisation. Transfer learning solved this problem by allowing us to take a pre-trained model of a task and use it for others.Today, transfer learning is at the heart of language models like Embeddings from Language … [Read more...] about An Ultimate Guide To Transfer Learning In NLP
Natural Language Processing
10 Important Research Papers In Conversational AI From 2019
Conversational AI is becoming an integral part of business practice across industries. More companies are adopting the advantages chatbots bring to customer service, sales, and marketing.Even though chatbots are becoming a “must-have” asset for leading businesses, their performance is still very far from human. Researchers from major research institutions and tech leaders … [Read more...] about 10 Important Research Papers In Conversational AI From 2019
What Are Major NLP Achievements & Papers From 2019?
UPDATE: We’ve also summarized the top 2020 NLP research papers. In 2018 we saw a number of landmark research breakthroughs in the field of natural language processing (NLP). The introduction of transfer learning and pretrained language models in NLP pushed forward the limits of language understanding and generation. These also dominated NLP progress this … [Read more...] about What Are Major NLP Achievements & Papers From 2019?
Productionizing NLP Models
Problem statement 💰Lately, I have been consolidating my experiences of working in different ML projects. I will tell this story from the lens of my recent NLP project to classify phrases into categories — A multiclass single label problem.Team structure 👪Making AI teams is quite tricky. If you don’t have the skillsets inside your company, you have to plan … [Read more...] about Productionizing NLP Models
Top NLP Research Trends From ACL 2019
This year, I had the chance to attend the ACL 2019 conference in Florence. It was my first NLP academic conference, and I was eager to attend as many sessions as possible. In contrast to most of the attendees, I was not interested in any particular research area. Instead, I wanted to pick up on the general NLP trends - so I was happy to hear about the latest advances in … [Read more...] about Top NLP Research Trends From ACL 2019
Top NLP Research Papers With Business Applications From ACL 2019
This year’s annual meeting of the Association for Computational Linguistics (ACL 2019) was bigger than ever. Although the conference received 75% more submissions than last year, the quality of the research papers remained high, and so the acceptance rates are almost the same.It is becoming more and more challenging to keep track of the latest research advances in your area … [Read more...] about Top NLP Research Papers With Business Applications From ACL 2019
XLNet, ERNIE 2.0, And RoBERTa: What You Need To Know About New 2019 Transformer Models
Large pretrained language models are definitely the main trend of the latest research advances in natural language processing (NLP).While lots of AI experts agree with Anna Rogers’s statement that getting state-of-the-art results with just more data and computing power is not research news, other NLP opinion leaders also see some positive moments in the current trend. For … [Read more...] about XLNet, ERNIE 2.0, And RoBERTa: What You Need To Know About New 2019 Transformer Models
Getting Started with Text Preprocessing for Machine Learning & NLP
Based on some recent conversations, I realized that text preprocessing is a severely overlooked topic. A few people I spoke to mentioned inconsistent results from their NLP applications only to realize that they were not preprocessing their text or were using the wrong kind of text preprocessing for their project.With that in mind, I thought of shedding some light around … [Read more...] about Getting Started with Text Preprocessing for Machine Learning & NLP
Building NLP Classifiers Cheaply With Transfer Learning and Weak Supervision
IntroductionThere is a catch to training state-of-the-art NLP models: their reliance on massive hand-labeled training sets. That’s why data labeling is usually the bottleneck in developing NLP applications and keeping them up-to-date. For example, imagine how much it would cost to pay medical specialists to label thousands of electronic health records. In general, having … [Read more...] about Building NLP Classifiers Cheaply With Transfer Learning and Weak Supervision
OpenAI’s GPT-2: Results, Hype, and Controversies
The nonprofit AI research company, OpenAI, recently released a new language model, called GPT-2, which is capable of generating realistic texts in a wide range of styles. In fact, the company stated that the model is so good at automatic text generation that it can be used for nefarious purposes; therefore, it did not publicize the trained model.The dangerous-to-release … [Read more...] about OpenAI’s GPT-2: Results, Hype, and Controversies