Kohesio: discover EU projects in your region

European Commission Topic
European Commission Topic

Vision tracking technology for human-adapted multifocal augmented reality

The project aims to promote the introduction of augmented reality (AR) close-to-eye display technology in the professional and consumer segments by integrating eye tracking into multifocal image rendering and psycho-emotional status assessment. The aim of this project is to explore the role of eye tracking in rendering multifocal images and the possible use of data to assess the psycho-emotional state of the user (anxiety, stress, loss of attention, fatigue, cyber-disease, etc.). Cooperation between the Optometry and Vision Science Department of the University of Latvia and Macro Innovation will promote innovations in line with Latvia’s Smart Specialisation Strategy (RIS3) – Focus Area 3. (Photonic and intelligent materials and engineering systems) and additional focal area 5. (Information and Communication Technologies). The project will boost productivity, export potential and innovation in healthcare, education, manufacturing and ICT sectors, contributing to the transformation of the economy. The creators include three technological innovations, €656,455.14 investment in R&D, five scientific publications and the development of high-skilled skills for researchers, in line with the RIS3 objectives of competitiveness, workforce development and cross-sectoral cooperation.AR has become the engine of the digital economy, transforming healthcare, education, manufacturing and other sectors. Devices such as Microsoft HoloLens 2, Apple Vision Pro and Meta Orion glasses demonstrate the potential and practical applications of AR, while the involvement of tech companies confirms its importance in future technologies.Challenges to integration and user experienceDespite the potential of AR, users often experience visual discomfort, such as eye fatigue, headaches and cyber-disease, which is especially pronounced in professional areas. Up to 80% of users experience these problems, mainly caused by the convergence-accommodation conflict. This makes comfort difficult and limits the use of AM over short distances or for precise tasks.Technical advances: Multifocal displaysMultifocal displays that divide images into depth layers that users perceive dynamically offer a promising solution. Unlike traditional monofocal systems, multifocal displays provide appropriate focus guidance for different depths, reducing visual fatigue and improving spatial perception. From holographic, light field and multifocal display prototypes, it is the multifocal systems that are closest to commercialization. These systems provide detailed 3D visualisation, which is essential for professional work assignments, but challenges remain in calibration and real-time customisation.Restrictions on the development of a human-centric approachThe main constraints are related to the time-consuming calibration procedure and the lack of real-time customisation of digital content according to the visual characteristics of users. In addition, most AR technologies do not take into account the diversity of people's visual functions, excluding people with visual impairments or perception characteristics. As visual impairments become more common, inclusive AR design becomes more and more important. As a rule, developers of AR systems mainly focus on technical indicators such as resolution and brightness, often without paying attention to human factors such as binocular vision and neurophysiological processes, which are essential for the safe and effective use of AR.The proposed solution and research directionThis project addresses these limitations by integrating real-time eye tracking with human-adapted multifocal AR systems. Eye tracking will allow you to continuously calibrate and customize 3D digital content, providing an individually tailored user experience. By studying individual differences in visual system responses to AR displays, the project aims to develop methodologies for effective eye tracking calibration, improving accuracy and user comfort. The study will set new standards for extended vision functionality, promoting innovations that make AR technology more inclusive, adaptable and efficient in professional contexts.Synergies between academia and industryThe Optometry and Vision Science Department of the University of Latvia, in cooperation with Macro Innovation, has extensive expertise in multifocal display technologies and human factors. This partnership has provided in the past highly valued research that has improved spatial perceptions in healthcare settings. Based on these developments, this project will allow interdisciplinary collaboration to expand the application possibilities of AR, creating the basis for safer, more inclusive and transformative applications in various industries.The research methodology of this project focuses on the development of solid state multifocal-eye close-to-the-eye display architecture, aiming at accurate image depiction and solving optical challenges in augmented reality (AR). A critical technical issue is to

Flag of Latvia  Multiple locations, Latvia