The world of Machine Learning is undoubtedly fascinating, constantly growing, and capable of touching the most diverse sectors, from medicine to space racing, from catering to big manufacturing. There are countless fields of application for this technology and just as many techniques that have been developed over the decades, but they all have one thing in common: … [Read more...] about Transformers And Multimodal: The Same Key For All Data Types
The Creative Side Of Vision Transformers
What's creativity? The most accredited definition is the following: “Creativity is the capability of creating novel things” It is considered one of the most important and irreplaceable peculiarities of humankind. But if this is such a special characteristic, it would be impossible for a neural network to imitate it, isn't it? Well, not exactly. Today we are facing some … [Read more...] about The Creative Side Of Vision Transformers
How Does An AI Imagine The Universe?
What’s out there? In this vast, infinite and inconceivable universe… Stars, planets, nebulae and celestial bodies are colliding, orbiting, being born and dying since the dawn of time. Humans have always looked up to the sky with fascination, imagining fantastic worlds and unreachable galaxies, and this has prompted mankind to use science to better understand the … [Read more...] about How Does An AI Imagine The Universe?
Self-Supervised Learning In Vision Transformers
Anyone who has ever approached the world of machine learning has certainly heard of supervised learning and unsupervised learning. These are in fact two important possible approaches to Machine Learning that have been widely used for years. Only recently, however, has there been an explosion of a new term, Self-Supervised Learning! But let’s get there step by step and look at … [Read more...] about Self-Supervised Learning In Vision Transformers
Vision Transformers or Convolutional Neural Networks? Both!
The field of Computer Vision has for years been dominated by Convolutional Neural Networks (CNNs). Through the use of filters, these networks are able to generate simplified versions of the input image by creating feature maps that highlight the most relevant parts. These features are then used by a multi-layer perceptron to perform the desired classification. But recently … [Read more...] about Vision Transformers or Convolutional Neural Networks? Both!
Should Machine Learning Experts Respond to Climate Change Call To Action?
Our planet's proper functioning and survival rely on a delicate balance of a vast heterogeneity of animal, plant, and microorganism species that contribute to the ecosystem established on Earth. Of all the organisms, there is one that has had a great impact on the planet, so great that it was capable of upsetting its balance, causing entire ecosystems to disappear and … [Read more...] about Should Machine Learning Experts Respond to Climate Change Call To Action?
Is Attention What You Really Need In Transformers?
In recent years there has been an explosion of methods based on self-attention and in particular Transformers, first in the field of Natural Language Processing and recently also in the field of Computer Vision. If you don’t know what Transformers are, or if you want to know more about the mechanism of self-attention, I suggest you have a look at my first article on this … [Read more...] about Is Attention What You Really Need In Transformers?
On DINO, Self-Distillation With No Labels
It has been clear for some time that the Transformers had arrived in the field of computer vision to amaze, but hardly anyone could have imagined such astonishing results from a Vision Transformer in such a short time since their first application. In this article, we discuss one of the most interesting advances in the field of computer vision, DINO, announced a few days … [Read more...] about On DINO, Self-Distillation With No Labels
On Transformers, TimeSformers, And Attention
Transformers are a very powerful Deep Learning model that has been able to become a standard in many Natural Language Processing tasks and is poised to revolutionize the field of Computer Vision as well. It all began in 2017 when Google Brain published the paper destined to change everything, Attention Is All You Need [4]. Researchers apply this new architecture to … [Read more...] about On Transformers, TimeSformers, And Attention