The leading pre-trained language models demonstrate remarkable performance on different NLP tasks, making them a much-welcomed tool for a number of applications, including sentiment analysis, chatbots, text summarization, and so on. However, good performance usually comes at the cost of enormous computational resources that are not accessible by most researchers and business … [Read more...] about Reformer, Longformer, and ELECTRA: Key Updates To Transformer Architecture In 2020
Research
The Highest-Trending Research Papers From CVPR 2020
CVPR 2020 is yet another big AI conference that takes place 100% virtually this year. But regardless of the format, the conference still showcases the most interesting cutting-edge research ideas in computer vision and image generation. Here we’ve picked up the research papers that started trending within the AI research community months before their actual presentation at … [Read more...] about The Highest-Trending Research Papers From CVPR 2020
The Best NLP Papers From ICLR 2020
I went through 687 papers that were accepted to ICLR 2020 virtual conference (out of 2594 submitted - up 63% since 2019!) and identified 9 papers with the potential to advance the use of deep learning NLP models in everyday use cases. Here are the papers found and why they matter. ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators Kevin … [Read more...] about The Best NLP Papers From ICLR 2020
5 Ways To Leverage AI Research In Marketing & Advertising
Today, Artificial Intelligence (AI) can drive effective solutions to lots of marketing challenges. It can help you optimize your advertising budget, personalize your customers’ experience, suggest the most accurate attribution model, boost your marketing analytics, and even generate original brand content, including images and advertising slogans. However, AI is evolving so … [Read more...] about 5 Ways To Leverage AI Research In Marketing & Advertising
The Dark Secrets Of BERT
This blog post summarizes EMNLP 2019 paper Revealing the Dark Secrets of BERT by researchers from the Text Machine Lab at UMass Lowell: Olga Kovaleva (LinkedIn), Alexey Romanov (LinkedIn), Anna Rogers (Twitter: @annargrs), and Anna Rumshisky (Twitter: @arumshisky). Here are the topics covered: A brief intro to … [Read more...] about The Dark Secrets Of BERT
Top 10 Technical AI and Machine Learning Conferences in 2020
The AI & ML field is growing at a very fast rate, and as a research scientist or ML engineer, you definitely want to keep track of the latest research advances, especially in your area of interest. To stay aware of the most important research breakthroughs, you can follow our regular research summaries across the main ML research fields. For connecting with other … [Read more...] about Top 10 Technical AI and Machine Learning Conferences in 2020
Top AI & ML Research Trends For 2020
The AI industry is moving so quickly that it’s often hard to follow the latest research breakthroughs and achievements. To help you stay well prepared for 2020, we have summarized the latest trends across different research areas, including natural language processing, conversational AI, computer vision, and reinforcement learning. We also suggest key research papers in … [Read more...] about Top AI & ML Research Trends For 2020
Breakthrough Research In Reinforcement Learning From 2019
Reinforcement learning (RL) continues to be less valuable for business applications than supervised learning, and even unsupervised learning. It is successfully applied only in areas where huge amounts of simulated data can be generated, like robotics and games. However, many experts recognize RL as a promising path towards Artificial General Intelligence (AGI), or true … [Read more...] about Breakthrough Research In Reinforcement Learning From 2019
Top 12 AI Ethics Research Papers Introduced In 2019
As the importance of ethical considerations in AI applications is being recognized not only by ethicists and researchers but also by industry tech leaders, AI ethics research is moving from general definitions of fairness and bias to more in-depth analysis. The research papers introduced in 2019 define comprehensive terminology for communicating about ML fairness, go from … [Read more...] about Top 12 AI Ethics Research Papers Introduced In 2019
TOPBOTS Guide To NeurIPS 2019
This year’s Annual Conference on Neural Information Processing (NeurIPS 2019) will be held in Vancouver, Canada from December 8th to 14th, 2019. The popularity of this conference is growing rapidly, with the number of submitted papers getting to the record-breaking number of 6743, almost 40% more than last year. The TOPBOTS team is also going to NeurIPS again this year. To … [Read more...] about TOPBOTS Guide To NeurIPS 2019