by Albert Alsina (ERNI Spain)
Technology takes on its deepest meaning when it serves people. This belief has guided us in joining forces with ABB and Fundación SIFU to create an innovative project that brings music within reach of those who once thought it impossible.
By combining robotics, artificial intelligence and human creativity, we have developed a system that allows a young pianist with cerebral palsy, Joel Bueno, to play a traditional piano using only his eyes.
What began as a technological challenge has become a symbol of inclusion and emotion, proving that engineering can connect hearts as much as machines.
Turning innovation into emotion
At the heart of this project lies a unique integration between ABB’s robotic arm and EyeHarp, a digital instrument that translates eye movements into musical notes. The system tracks where the player is looking on a circular interface, allowing them to select and play notes with precision and fluency.
To make those digital notes resonate on a real piano, our team developed a predictive algorithm inspired by genetic alignment models, a concept borrowed from bioinformatics. This algorithm enables the robot to anticipate the next note before it is played. By processing both the expected note and the one actually triggered by the musician, the system can move towards the correct piano key in advance. The result is a performance that feels natural, fast and deeply expressive, mirroring the rhythm and emotion of the player almost instantaneously.
Developed in 2024 and refined in 2025, this intelligent control system bridges the gap between human intention and robotic execution. It’s a vivid example of our belief in technology with purpose, using innovation to create meaningful impact.
A collaboration that amplifies human potential
This initiative is more than a technological milestone; it’s a story of collaboration and shared vision:
- ABB Robotics, one of the world’s leading robotics and automation suppliers, contributed its expertise in robotics and precision motion.
- Fundación SIFU, with its long-standing commitment to inclusion and accessibility, ensured that the human and social impact remained at the centre of the project.
- We at ERNI, as a software engineering company, brought the artificial intelligence and algorithmic capabilities that make the system responsive and musical.
Together, we’ve shown how technology, empathy and creativity can work in harmony to open new frontiers of artistic and personal expression for people with disabilities.
Technology with purpose
Technology is not just about progress, it’s about purpose. This collaboration with ABB and Fundación SIFU shows that engineering reaches its greatest value when it improves lives, connects people and amplifies human potential.
Through this project, we’ve seen how technology can anticipate music, but more importantly, how empathy can guide innovation. It turns inclusion into reality and changes the world, one note at a time.