Despite the challenges of 2020, the AI research community produced a number of meaningful technical breakthroughs. GPT-3 by OpenAI may be the most famous, but there are definitely many other research papers worth your attention. For example, teams from Google introduced a revolutionary chatbot, Meena, and EfficientDet object detectors in image recognition. Researchers … [Read more...] about 2020’s Top AI & Machine Learning Research Papers
Research Summaries
GPT-3 & Beyond: 10 NLP Research Papers You Should Read
NLP research advances in 2020 are still dominated by large pre-trained language models, and specifically transformers. There were many interesting updates introduced this year that have made transformer architecture more efficient and applicable to long documents.Another hot topic relates to the evaluation of NLP models in different applications. We still lack evaluation … [Read more...] about GPT-3 & Beyond: 10 NLP Research Papers You Should Read
Novel Computer Vision Research Papers From 2020
Will transformers revolutionize computer vision like they did with natural language processing? That’s one of the major research questions investigated by computer vision scientists in 2020. The first results indicate that transformers achieve very promising results on image recognition tasks.Beyond transformers in vision applications, we also noticed a continuous … [Read more...] about Novel Computer Vision Research Papers From 2020
The Latest Breakthroughs in Conversational AI Agents
2020 is the breakthrough year for conversational agents. First, Google’s chatbot Meena and Facebook’s chatbot Blender demonstrated that dialog agents can achieve close to human-level performance in certain tasks. Then, OpenAI’s GPT-3 model made lots of people wonder whether Artificial General Intelligence (AGI) is already here. While we are still a long way off true AGI, … [Read more...] about The Latest Breakthroughs in Conversational AI Agents
Best Research Papers From ICML 2020
This year’s virtual ICML conference hosted 10800+ attendees from 75 countries. Apparently, the virtual format makes big research conferences such as ICML more accessible to the AI community all over the world.With almost 5000 research papers submitted to ICML 2020 and an acceptance rate of 21.8%, a total of 1088 papers were presented at the conference. As usual, the … [Read more...] about Best Research Papers From ICML 2020
Best Research Papers From ACL 2020
ACL is the leading conference in the field of natural language processing (NLP), covering a broad spectrum of research areas in computational linguistics. Due to the COVID-19 risks, ACL 2020 took place 100% virtually, similar to other big academic conferences of this year.However, as always, it was the best place to learn about the latest NLP research trends and … [Read more...] about Best Research Papers From ACL 2020
8 Leading Language Models For NLP In 2020
The introduction of transfer learning and pretrained language models in natural language processing (NLP) pushed forward the limits of language understanding and generation. Transfer learning and applying transformers to different downstream NLP tasks have become the main trend of the latest research advances.At the same time, there is a controversy in the NLP community … [Read more...] about 8 Leading Language Models For NLP In 2020
Reformer, Longformer, and ELECTRA: Key Updates To Transformer Architecture In 2020
The leading pre-trained language models demonstrate remarkable performance on different NLP tasks, making them a much-welcomed tool for a number of applications, including sentiment analysis, chatbots, text summarization, and so on. However, good performance usually comes at the cost of enormous computational resources that are not accessible by most researchers and business … [Read more...] about Reformer, Longformer, and ELECTRA: Key Updates To Transformer Architecture In 2020
The Highest-Trending Research Papers From CVPR 2020
CVPR 2020 is yet another big AI conference that takes place 100% virtually this year. But regardless of the format, the conference still showcases the most interesting cutting-edge research ideas in computer vision and image generation.Here we’ve picked up the research papers that started trending within the AI research community months before their actual presentation at … [Read more...] about The Highest-Trending Research Papers From CVPR 2020
Breakthrough Research In Reinforcement Learning From 2019
Reinforcement learning (RL) continues to be less valuable for business applications than supervised learning, and even unsupervised learning. It is successfully applied only in areas where huge amounts of simulated data can be generated, like robotics and games.However, many experts recognize RL as a promising path towards Artificial General Intelligence (AGI), or true … [Read more...] about Breakthrough Research In Reinforcement Learning From 2019