NLP research advances in 2020 are still dominated by large pre-trained language models, and specifically transformers. There were many interesting updates introduced this year that have made transformer architecture more efficient and applicable to long documents. Another hot topic relates to the evaluation of NLP models in different applications. We still lack evaluation … [Read more...] about GPT-3 & Beyond: 10 NLP Research Papers You Should Read
natural language processing
4 Approaches To Natural Language Processing & Understanding
In 1971, Terry Winograd wrote the SHRDLU program while completing his PhD at MIT. SHRDLU features a world of toy blocks where the computer translates human commands into physical actions, such as “move the red pyramid next to the blue cube.” To succeed in such tasks, the computer must build up semantic knowledge iteratively, a process Winograd discovered was brittle and … [Read more...] about 4 Approaches To Natural Language Processing & Understanding