TOPBOTS

The Best of Applied Artificial Intelligence, Machine Learning, Automation, Bots, Chatbots

Lilian Weng

The Multi-Armed Bandit Problem and Its Solutions

by

The multi-armed bandit problem is a classic example to demonstrate the exploration versus exploitation dilemma. This post introduces the bandit problem and how to solve it using different exploration strategies.Exploitation vs ExplorationWhat is Multi-Armed Bandit?DefinitionBandit Strategiesε-Greedy AlgorithmUpper Confidence BoundsHoeffding’s InequalityUCB1Bayesian … [Read more...] about The Multi-Armed Bandit Problem and Its Solutions

Generalized Language Models: Common Tasks & Datasets

by

EDITOR'S NOTE: Generalized Language Models is an extensive four-part series by Lillian Weng of OpenAI. Part 1: CoVe, ELMo & Cross-View TrainingPart 2: ULMFiT & OpenAI GPTPart 3: BERT & OpenAI GPT-2Part 4: Common Tasks & DatasetsDo you find this in-depth technical education about language models and NLP applications to be useful? Subscribe below to … [Read more...] about Generalized Language Models: Common Tasks & Datasets

Generalized Language Models: BERT & OpenAI GPT-2

by

EDITOR'S NOTE: Generalized Language Models is an extensive four-part series by Lillian Weng of OpenAI. Part 1: CoVe, ELMo & Cross-View TrainingPart 2: ULMFiT & OpenAI GPTPart 3: BERT & OpenAI GPT-2Part 4: Common Tasks & DatasetsDo you find this in-depth technical education about language models and NLP applications to be useful? Subscribe below to … [Read more...] about Generalized Language Models: BERT & OpenAI GPT-2

Generalized Language Models: ULMFiT & OpenAI GPT

by

EDITOR'S NOTE: Generalized Language Models is an extensive four-part series by Lillian Weng of OpenAI. Part 1: CoVe, ELMo & Cross-View TrainingPart 2: ULMFiT & OpenAI GPTPart 3: BERT & OpenAI GPT-2Part 4: Common Tasks & DatasetsDo you find this in-depth technical education about language models and NLP applications to be useful? Subscribe below to … [Read more...] about Generalized Language Models: ULMFiT & OpenAI GPT

Generalized Language Models: CoVe, ELMo & Cross-View Training

by

EDITOR'S NOTE: Generalized Language Models is an extensive four-part series by Lillian Weng of OpenAI. Part 1: CoVe, ELMo & Cross-View TrainingPart 2: ULMFiT & OpenAI GPTPart 3: BERT & OpenAI GPT-2Part 4: Common Tasks & DatasetsDo you find this in-depth technical education about language models and NLP applications to be useful? Subscribe below to … [Read more...] about Generalized Language Models: CoVe, ELMo & Cross-View Training