NLP research advances in 2020 are still dominated by large pre-trained language models, and specifically transformers. There were many interesting updates introduced this year that have made transformer architecture more efficient and applicable to long documents.Another hot topic relates to the evaluation of NLP models in different applications. We still lack evaluation … [Read more...] about GPT-3 & Beyond: 10 NLP Research Papers You Should Read
Research
Novel Computer Vision Research Papers From 2020
Will transformers revolutionize computer vision like they did with natural language processing? That’s one of the major research questions investigated by computer vision scientists in 2020. The first results indicate that transformers achieve very promising results on image recognition tasks.Beyond transformers in vision applications, we also noticed a continuous … [Read more...] about Novel Computer Vision Research Papers From 2020
Graph Convolutional Networks (GCN)
In this post, we’re gonna take a close look at one of the well-known graph neural networks named Graph Convolutional Network (GCN). First, we’ll get the intuition to see how it works, then we’ll go deeper into the maths behind it.Why Graphs?Many problems are graphs in true nature. In our world, we see many data are graphs, such as molecules, social … [Read more...] about Graph Convolutional Networks (GCN)
Evaluation Metrics For Dialog Systems
Evaluation is a crucial part of the dialog system development process. Human judgment is considered a gold standard for the evaluation of dialog agents. However, this is also a very expensive and time-intensive approach. Thus, researchers mostly rely on automatic metrics when developing dialog systems.In this article, we’ll introduce a brief overview of the key evaluation … [Read more...] about Evaluation Metrics For Dialog Systems
Key Dialog Datasets: Overview and Critique
To build a state-of-the-art dialog system, you need challenging tasks for model training and evaluation. There are numerous dialog datasets that assist researchers in building task-oriented and chit-chat dialog agents. In particular, the Facebook Research team has introduced a framework, called ParlAI (pronounced par-lay), where they’ve gathered together 80+ popular dialog … [Read more...] about Key Dialog Datasets: Overview and Critique
Task-Oriented Dialog Agents: Recent Advances and Challenges
Hotel bookings, weather queries, restaurant reservations – chatbots and virtual assistants seem to be the perfect solution for these kinds of routine inquiries. Not surprisingly, task-oriented dialog systems that support these chatbots have become a hot topic in the AI and NLP research community.In this article, we will review the recent research breakthroughs in … [Read more...] about Task-Oriented Dialog Agents: Recent Advances and Challenges
The Latest Breakthroughs in Conversational AI Agents
2020 is the breakthrough year for conversational agents. First, Google’s chatbot Meena and Facebook’s chatbot Blender demonstrated that dialog agents can achieve close to human-level performance in certain tasks. Then, OpenAI’s GPT-3 model made lots of people wonder whether Artificial General Intelligence (AGI) is already here. While we are still a long way off true AGI, … [Read more...] about The Latest Breakthroughs in Conversational AI Agents
ECCV 2020: Some Highlights
The 2020 European Conference on Computer Vision took place online, from 23 to 28 August, and consisted of 1360 papers, divided into 104 orals, 160 spotlights and the rest of 1096 papers as posters. In addition to 45 workshops and 16 tutorials. As it is the case in recent years with ML and CV conferences, the huge number of papers can be overwhelming at times. Similar to … [Read more...] about ECCV 2020: Some Highlights
3 NLP Interpretability Tools For Debugging Language Models
With constant advances and unprecedented performance on many NLP tasks, language models have gotten really complex and hard to debug. Researchers and engineers often can’t easily answer questions like: Why did your model make that prediction? Does your model have any algorithmic biases?What kind of data samples does your model perform poorly … [Read more...] about 3 NLP Interpretability Tools For Debugging Language Models
Best Research Papers From ICML 2020
This year’s virtual ICML conference hosted 10800+ attendees from 75 countries. Apparently, the virtual format makes big research conferences such as ICML more accessible to the AI community all over the world.With almost 5000 research papers submitted to ICML 2020 and an acceptance rate of 21.8%, a total of 1088 papers were presented at the conference. As usual, the … [Read more...] about Best Research Papers From ICML 2020