The introduction of transfer learning and pretrained language models in natural language processing (NLP) pushed forward the limits of language understanding and generation. Transfer learning and applying transformers to different downstream NLP tasks have become the main trend of the latest research advances.At the same time, there is a controversy in the NLP community … [Read more...] about 10 Leading Language Models For NLP In 2022
NLP Research Papers
AI Approaches For Text Generation In Marketing & Advertising Use Cases
This research summary is part of our AI for Marketing series which covers the latest AI & machine learning approaches to 5 aspects of marketing automation:AttributionOptimizationPersonalizationAnalyticsContent Generation: ImagesContent Generation: VideosContent Generation: TextCan AI help you write high converting copy for your advertising and marketing … [Read more...] about AI Approaches For Text Generation In Marketing & Advertising Use Cases
NeurIPS 2020 Papers: Takeaways for a Deep Learning Engineer
Advances in Deep Learning research are of great utility for a Deep Learning engineer working on real-world problems as most of the Deep Learning research is empirical with validation of new techniques and theories done on datasets that closely resemble real-world datasets/tasks (ImageNet pre-trained weights are still useful!).But, churning a vast amount of … [Read more...] about NeurIPS 2020 Papers: Takeaways for a Deep Learning Engineer
NeurIPS 2020: Key Research Papers in Natural Language Processing (NLP) & Conversational AI
NeurIPS is the largest machine learning conference held every December. It brings together researchers in computational neuroscience, reinforcement learning, deep learning, and their applications such as computer vision, fairness and transparency, natural language processing, robotics, and more.Our team reviewed the papers accepted to NeurIPS 2020 and shortlisted the most … [Read more...] about NeurIPS 2020: Key Research Papers in Natural Language Processing (NLP) & Conversational AI
GPT-3 & Beyond: 10 NLP Research Papers You Should Read
NLP research advances in 2020 are still dominated by large pre-trained language models, and specifically transformers. There were many interesting updates introduced this year that have made transformer architecture more efficient and applicable to long documents.Another hot topic relates to the evaluation of NLP models in different applications. We still lack evaluation … [Read more...] about GPT-3 & Beyond: 10 NLP Research Papers You Should Read
Best Research Papers From ACL 2020
ACL is the leading conference in the field of natural language processing (NLP), covering a broad spectrum of research areas in computational linguistics. Due to the COVID-19 risks, ACL 2020 took place 100% virtually, similar to other big academic conferences of this year.However, as always, it was the best place to learn about the latest NLP research trends and … [Read more...] about Best Research Papers From ACL 2020
Reformer, Longformer, and ELECTRA: Key Updates To Transformer Architecture In 2020
The leading pre-trained language models demonstrate remarkable performance on different NLP tasks, making them a much-welcomed tool for a number of applications, including sentiment analysis, chatbots, text summarization, and so on. However, good performance usually comes at the cost of enormous computational resources that are not accessible by most researchers and business … [Read more...] about Reformer, Longformer, and ELECTRA: Key Updates To Transformer Architecture In 2020
The Best NLP Papers From ICLR 2020
I went through 687 papers that were accepted to ICLR 2020 virtual conference (out of 2594 submitted - up 63% since 2019!) and identified 9 papers with the potential to advance the use of deep learning NLP models in everyday use cases.Here are the papers found and why they matter.ELECTRA: Pre-training Text Encoders as Discriminators Rather Than GeneratorsKevin … [Read more...] about The Best NLP Papers From ICLR 2020
What Are Major NLP Achievements & Papers From 2019?
UPDATE: We’ve also summarized the top 2020 NLP research papers. In 2018 we saw a number of landmark research breakthroughs in the field of natural language processing (NLP). The introduction of transfer learning and pretrained language models in NLP pushed forward the limits of language understanding and generation. These also dominated NLP progress this … [Read more...] about What Are Major NLP Achievements & Papers From 2019?
Top NLP Research Papers With Business Applications From ACL 2019
This year’s annual meeting of the Association for Computational Linguistics (ACL 2019) was bigger than ever. Although the conference received 75% more submissions than last year, the quality of the research papers remained high, and so the acceptance rates are almost the same.It is becoming more and more challenging to keep track of the latest research advances in your area … [Read more...] about Top NLP Research Papers With Business Applications From ACL 2019