This article was originally published on the author’s blog and re-published to TOPBOTS with permission from the author. Large language models such as ChatGPT process and generate text sequences by first splitting the text into smaller units called tokens. In the image below, each colored block represents a unique token. Short or common words such as “you”, “say”, “loud”, and … [Read more...] about All Languages Are NOT Created (Tokenized) Equal
Guest
Four LLM Trends Since ChatGPT And Their Implications For AI Builders
In October 2022, I published an article on LLM selection for specific NLP use cases , such as conversation, translation and summarisation. Since then, AI has made a huge step forward, and in this article, we will review some of the trends of the past months as well as their implications for AI builders. Specifically, we will cover the topics of task selection for … [Read more...] about Four LLM Trends Since ChatGPT And Their Implications For AI Builders
Exploring Creativity in Large Language Models: From GPT-2 to GPT-4
Creativity as envisioned by Midjourney. Generated by the author This article was originally published on the author’s blog and re-published to TOPBOTS with permission from the author. In recent weeks, people have used large language models (LLMs) to generate a variety of creative content, such as books, flash fiction, rap battles, and music chords. But is it possible to … [Read more...] about Exploring Creativity in Large Language Models: From GPT-2 to GPT-4
Does AI Have Political Opinions?
This article was originally published on the author's blog and re-published to TOPBOTS with permission from the author. There’s a quote about how in polite society, you should never talk about three things: politics, religion, and money. In this article, I break polite conventions to determine how an AI would respond to all three of those topics. As AI tools become more and … [Read more...] about Does AI Have Political Opinions?
The Evolution Of Science: From Descartes To Generative AI
Image generated by ArtMyko using Midjourney The belief that science means observable and repeatable experiments, which began with Descartes in the seventeenth century, is, to this extent, over. Global understanding is, by contrast, based on computational models supported by a knowledge infrastructure. — How to See the World, Nicolas Mirzoeff The Arabic numeral system … [Read more...] about The Evolution Of Science: From Descartes To Generative AI
Part 3. AI — A New Approach to Research, Innovation and Entrepreneurship
Credit: [1] “…it is the scale of physics where life emerges, but that life itself is a broader phenomenon recurring across different scales, from chemistry to cells to societies–which more generally concerns the interactions of information (an abstract property) with matter.” [2] In Part 1 of this series I discussed how artificial intelligence (AI) has … [Read more...] about Part 3. AI — A New Approach to Research, Innovation and Entrepreneurship
Overcoming The Limitations Of Large Language Models
How popular LLMs score along human cognitive skills (source: semantic embedding analysis of ca. 400k AI-related online texts since 2021) Disclaimer: This article was written without the support of ChatGPT. In the last couple of years, Large Language Models (LLMs) such as ChatGPT, T5 and LaMDA have developed amazing skills to produce human language. We are quick to … [Read more...] about Overcoming The Limitations Of Large Language Models
Part 2. Generative AI: It Could Redefine “The Theory of Knowledge”
Credit: DALL-E 2 “The contemplation in natural science of a wider domain than the actual leads to a far better understanding of the actual.” — Sir Arthur Eddington In Part 1 of this series, I said “I will refrain from saying that Generative Artificial Intelligence (AI) is the basis for a third school of epistemology”, but recently, I read about the challenges in … [Read more...] about Part 2. Generative AI: It Could Redefine “The Theory of Knowledge”
Part 1. Generative AI: Every Problem is an Information Problem
Image from https://beta.dreamstudio.ai/dream “But the overall pattern is clear: in case after case, when a model can be created and tested, it tends to perform as well as, or better than, human experts making similar decisions. Too often, we continue to rely on human judgment when machines can do better.” — Andrew McAfee, Erik Brynjolfsson [1] The writer David Foster … [Read more...] about Part 1. Generative AI: Every Problem is an Information Problem
Choosing The Right Language Model For Your NLP Use Case
Large Language Models (LLMs) are Deep Learning models trained to produce text. With this impressive ability, LLMs have become the backbone of modern Natural Language Processing (NLP). Traditionally, they are pre-trained by academic institutions and big tech companies such as OpenAI, Microsoft and NVIDIA. Most of them are then made available for public use. This plug-and-play … [Read more...] about Choosing The Right Language Model For Your NLP Use Case