Giving computers a sense of smell

By Ambuj Tewari

Over 100 years ago, Alexander Graham Bell asked the readers of National Geographic to do something bold and fresh – “to found a new science.” He pointed out that sciences based on the measurements of sound and light already existed. But there was no science of odour. Bell asked his readers to “measure a smell.”

Today, smartphones in most people’s pockets provide impressive built-in capabilities based on the sciences of sound and light: voice assistants, facial recognition and photo enhancement. The science of odour does not offer anything comparable. But that situation is changing, as advances in machine olfaction, also called “digitised smell,” are finally answering Bell’s call to action.

Research on machine olfaction faces a formidable challenge due to the complexity of the human sense of smell. Whereas human vision mainly relies on receptor cells in the retina, smell is experienced through about 400 types of receptor cells in the nose.

Machine olfaction starts with sensors that detect and identify molecules in the air. These sensors serve the same purpose as the receptors in your nose.

But to be useful to people, machine olfaction needs to go a step further. The system needs to know what a certain molecule or a set of molecules smells like to a human. For that, machine olfaction needs machine learning.

Machine learning is key to digitising smells because it can learn to map the molecular structure of an odour-causing compound to textual odour descriptors. The machine learning model learns the words humans tend to use – for example, “sweet” and “dessert” – to describe what they experience when they encounter specific odour-causing compounds, such as vanillin.

However, machine learning needs large datasets. The web has an unimaginably huge amount of audio, image and video content that can be used to train artificial intelligence systems that recognise sounds and pictures. But machine olfaction has long faced a data shortage problem, partly because most people cannot verbally describe smells as effortlessly and recognisably as they can describe sights and sounds.

However, things started to change in 2015 when researchers launched the DREAM Olfaction Prediction Challenge. The competition released data collected by Andreas Keller and Leslie Vosshall, biologists who study olfaction, and invited teams from around the world to submit their machine-learning models. The models had to predict odour labels like “sweet,” “flower” or “fruit” for odour-causing compounds based on their molecular structure.

A classic machine-learning technique called random forest, which combines the output of multiple decision tree flow charts, turned out to be the winner.

Progress in machine olfaction started picking up steam after the DREAM challenge concluded. During the Covid-19 pandemic, many cases of smell blindness, or anosmia, were reported. The sense of smell, which usually takes a back seat, rose in public consciousness. Additionally, a research project, the Pyrfume Project, made more and larger datasets publicly available.

By 2019, the largest datasets had grown from less than 500 molecules in the DREAM challenge to about 5,000 molecules. A Google Research team led by Alexander Wiltschko was finally able to bring the deep learning revolution to machine olfaction. Their model, based on a type of deep learning called graph neural networks, established state-of-the-art results in machine olfaction. Wiltschko is now the founder and CEO of Osmo, whose mission is “giving computers a sense of smell.”

Recently, Wiltschko and his team used a graph neural network to create a “principal odour map,” where perceptually similar odours are placed closer to each other than dissimilar ones. This was not easy: small changes in molecular structure can lead to large changes in olfactory perception. Conversely, two molecules with very different molecular structures can nonetheless smell almost the same.

Such progress in cracking the code of smell is not only intellectually exciting but also has highly promising applications, including personalised perfumes and fragrances, better insect repellents, novel chemical sensors, early detection of disease, and more realistic augmented reality experiences. The future of machine olfaction looks bright. It also promises to smell good.

Ambuj Tewari is Professor of Statistics, University of Michigan. This article is republished from The Conversation under a Creative Commons licence