Bluesyeye AI is revolutionising the way we measure social, emotional, and medically relevant behavior with the power of machine learning.

Specialising in the automatic analysis of facial and voice behavior, the company is pushing the boundaries of what we can understand about people’s mental states—specifically when it comes to medical, social, and emotional cues.

Their cutting-edge technology aims to become the most widely used tool for ethical, machine-driven understanding of facial expressions and voice behavior, offering a way to measure mental and emotional states through widely accessible, affordable devices, making the previously unmeasurable measurable. .

What sets Blueskeye’s technology apart is its clinical-grade precision. It has been rigorously tested in numerous clinical trials, ensuring both its efficacy and safety.

Currently, its primary application is in the automotive sector, where it is used to enhance the safety and wellbeing of drivers. By tracking signs of fatigue or alertness, the system can predict when drivers need rest, ultimately preventing accidents and improving overall travel experiences. In the future, vehicles equipped with this technology could function as mobile medical devices, turning the car cabin into a “doctor on wheels” for real-time health monitoring.

Michel explains

“It’s interesting that the current Euro NCAP and other regulations don’t really look at the prediction of sleep going forward, but it’s actually entirely feasible based on the data that we are collecting, and that is ultimately our goal – to predict early on that people are going to become sleepy, rather than that they are now asleep.

So, the purpose here is to get really fine grained data of how fatigued people are and how that fatigue is showing in your facial expressions, your tone of voice and generally speaking, just the behaviour that you exhibit as you drive.”

Blueskeye AI, a spin-out from the University of Nottingham, has over two decades of research behind them. The company’s mission is to create the most trusted and accurate technology for measuring mental states through the analysis of facial expressions and voice. Their technology aims to improve critical areas like healthcare, safety, and overall well-being.

What sets Blueskeye AI apart is their team. With 10 PhDs in neuroscience, computer science, machine learning, and psychology, the company combines expertise from multiple disciplines to solve complex problems related to human behavior. And they’re not just focusing on the basics. While many systems can detect simple things like whether someone’s eyes are closed or if they’re showing signs of fatigue, Blueskeye AI digs deeper.

Their technology aims to answer questions such as: Why is a person behaving in a certain way at a specific moment? Is a driver fatigued, or could they be at risk of a medical emergency like a heart attack? Or perhaps, they’re just excited—on their way to a celebration. By accurately inferring these mental states, Blueskeye AI is opening the door to a future where behavioral analysis is a key component in enhancing safety and well-being.

With its groundbreaking research and advanced technology, Blueskeye AI is not just observing behavior—it’s helping to understand it in ways we’ve never done before.

Michel tells us

“I think we’re actually going to a world where your car is this ideal environment to measure very slow variations in your brain capacity, in your brain health. And then your car can actually give you that data for you to take to the doctor and hopefully get an early detection.”

For nearly two years, Blueskeye AI has been working towards integrating its cutting-edge behavioral analysis technology into vehicles. A key milestone in this journey was proving that their system could accurately detect fatigue in drivers on real roads.

Testing such a crucial application in a real-world setting is, of course, fraught with challenges, particularly when it comes to safety. This is where the Zenzic CAM Scale Up UK programme became a game-changer for Blueskeye AI. The company was able to utilise the Horiba Mira test track—providing a controlled environment to safely assess the system’s performance.

On these tracks, the company was able to simulate extended driving periods designed to induce fatigue, allowing Blueskeye AI to test its technology under real conditions. The result was that they not only proved that their system could detect fatigue, but that it could do so early—potentially preventing accidents before they occur.

By collecting and analyzing this data, Blueskeye AI has taken an important step toward ensuring their fatigue detection system can make real-time, life-saving decisions on the road.

Michel explains:  “External validation of our capabilities is absolutely crucial, and that is particularly because we are new to market technology. This is not something that exists yet. There are no real comparators of this. And therefore, the quality of the validation data is really important.  And this programme really gave us the ability to create that high quality data.

What we were really surprised about is just how much people behave the same way when they become fatigued. It progresses in a very predictable manner.”

Blueskeye AI is excited about the future of their technology in vehicles, with plans to extend their measurements to include medical conditions. This could help drivers with health issues drive longer and offer early detection of certain conditions. A recent advancement is the integration into cars of emotionally and socially aware voice assistants, a field Blueskeye specialises in. These assistants will need to interpret human emotional signals, which is precisely what the company excels at. Additionally, the next generation of cars will be more adaptive, transforming the vehicle into an extension of the home or office, and Blueskeye will play a crucial role in this evolution.

Michel says:

“This is something that we’ve been working on for more than 20 years and to actually see all of this come to life now in the real world is so amazing. It’s such an honor and such a pleasure to be working on this.

I really thank the Zenic CAM Scale-Up UK programme for helping to make this dream come true and hopefully just make the world a better, safer, more pleasurable experience for everyone.”