Evaluation is a crucial part of the dialog system development process. Human judgment is considered a gold standard for the evaluation of dialog agents. However, this is also a very expensive and time-intensive approach. Thus, researchers mostly rely on automatic metrics when developing dialog systems. In this article, we’ll introduce a brief overview of the key evaluation … [Read more...] about Evaluation Metrics For Dialog Systems
Conversational AI
Key Dialog Datasets: Overview and Critique
To build a state-of-the-art dialog system, you need challenging tasks for model training and evaluation. There are numerous dialog datasets that assist researchers in building task-oriented and chit-chat dialog agents. In particular, the Facebook Research team has introduced a framework, called ParlAI (pronounced par-lay), where they’ve gathered together 80+ popular dialog … [Read more...] about Key Dialog Datasets: Overview and Critique
Task-Oriented Dialog Agents: Recent Advances and Challenges
Hotel bookings, weather queries, restaurant reservations – chatbots and virtual assistants seem to be the perfect solution for these kinds of routine inquiries. Not surprisingly, task-oriented dialog systems that support these chatbots have become a hot topic in the AI and NLP research community. In this article, we will review the recent research breakthroughs in … [Read more...] about Task-Oriented Dialog Agents: Recent Advances and Challenges
The Latest Breakthroughs in Conversational AI Agents
2020 is the breakthrough year for conversational agents. First, Google’s chatbot Meena and Facebook’s chatbot Blender demonstrated that dialog agents can achieve close to human-level performance in certain tasks. Then, OpenAI’s GPT-3 model made lots of people wonder whether Artificial General Intelligence (AGI) is already here. While we are still a long way off true AGI, … [Read more...] about The Latest Breakthroughs in Conversational AI Agents
10 Important Research Papers In Conversational AI From 2019
Conversational AI is becoming an integral part of business practice across industries. More companies are adopting the advantages chatbots bring to customer service, sales, and marketing. Even though chatbots are becoming a “must-have” asset for leading businesses, their performance is still very far from human. Researchers from major research institutions and tech leaders … [Read more...] about 10 Important Research Papers In Conversational AI From 2019
Why Bots Are So Difficult to Get Right
Most of today’s biggest companies have begun experimenting with chatbots, and many others are poised to follow suit. A recent survey found 56% of service leaders were actively looking for ways to integrate artificial intelligence, including chatbots. This surge in interest reflects the significant benefits this technology can offer: bots can save human agents time by providing … [Read more...] about Why Bots Are So Difficult to Get Right
Consumer Report Shows How Chatbots Accelerate Service & Improve Customer Journeys
Vanson Bourne and Bold360 powered by LogMeIn surveyed business leaders and consumers across the globe to understand how these groups view Customer Experience (CX), determine where there is still friction in CX, and define how emerging technology like Artificial Intelligence (AI) can help deliver better outcomes. Here are the key findings of the report: On average, less … [Read more...] about Consumer Report Shows How Chatbots Accelerate Service & Improve Customer Journeys
Top Research Papers in Conversational AI For Chatbots And Intelligent Agents
UPDATE: We've also summarized the top 2019 Conversational AI research papers. Conversational interfaces are permeating all aspects of our digital experiences. Digital assistants work alongside human agents to provide customer support. Chatbots are used to both market products and enable their purchases. IoT and other smart devices like Google Home or Amazon Echo enable … [Read more...] about Top Research Papers in Conversational AI For Chatbots And Intelligent Agents