Immersive Experience
IMMERSIVE PLATFORM
We build our AR platform using Unity game engine that allows us rapidly develop, test and deploy the most feasible soultions to a range of AR enviroments at once. We are focusing mostly on Microsoft HoloLens2, smartphones and tablet devices.
HUMAN-CENTERED DESIGN
As VR and AR interfaces are in their very core assistive technologies, we are putting a lot of emphasis on the users. We are developing our tools with the best practices and research regarding human-centered design. This allows for the wider and less uncertain prone adaptation of our tools by the practitioners and industry users.
RESEARCH
We base our work on the research results that use the analysis of physiological signals for the detection of changes of the affective conditions of the trainees.
THE SAMPLE OF WHAT WE WORK ON
AR GOGGLES
The video shows how the "digital twinning" concept coupled with QR-based tagging and Augmented Reality (AR) interface can be used to aid the assembly task.
All the elements of the object being assembled are tagged with QR-codes. This tagging mechanism is used to help the user differentiate between the object's parts and aids the selection process.
MOBILE AR
We use mobile devices to support remote instruction, installation, and conservation of a given device.
This support will takes the form of a mobile application connecting in real-time an expert working remotely with a person/employee physically present at the site (e.g. factory shop floor or in the field). By using a video stream coupled with a digital twin of a chosen device, we can extend and significantly improve cooperation between an expert and a non-expert user.
The proposed multi-platform (iOS and Android) mobile application uses the AR interface to improve and significantly increase the information transfer between users. For this purpose, it will be possible to mark an object visible on the screen or to superimpose selected additional information such as, for example, the use of the concept of a digital twin, i.e. a 3D model of the serviced device combined with additional data.
In addition, our application will allow you to create and save screenshots of the working screen during communication and remote work, as well as generate comprehensive reports on the implementation of remote diagnostics and support of repair processes, including user comments and screenshots.
OUR SCIENTIFIC CONTRIBUTION AND KNOW-HOW
MARS:
A Cross-Platform Mobile AR System for Remote Collaborative Instruction and Installation Support using Digital Twins
This paper describes a multi-user, mobile, cross-platform AR system that allows real-time remote collaboration utilizing the digital twinning concept. Thanks to cloud services, the users can collab-oratively manipulate and exchange information using digital twin realized as detailed multi-part 3D models. We also discuss design requirements and task analysis captured using engineering design methodology and the usability verification of our system using a heuristical approach.
S. K. Tadeja, D. Janik, P. Stachura, M. Tomecki, K. Książczak and K. Walas, "MARS: A Cross-Platform Mobile AR System for Remote Collaborative Instruction and Installation Support using Digital Twins," 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022, pp. 373-380, doi: 10.1109/VRW55335.2022.00083.
The full text can be found here
Design of ARQ:
An Augmented Reality System for Assembly Training Enhanced with QR-Tagging and 3D Engineering Asset Model
The object assembly process is frequently carried out throughout the lifespan of an asset. To prevent asset damage, it is necessary to perform adequate training to ensure process efficiency and appropriate asset handling. Thus, the industry constantly seeks better training solutions to reduce costs and maximize efficiency in the assembly task. Here, we present an augmented reality system to aid these efforts by using QR-tagging and 3D models. Moreover, we describe the system design using an engineering design methodology.
S. K. Tadeja, D. Janik, P. Stachura, M. Tomecki and K. Walas, "Design of ARQ: An Augmented Reality System for Assembly Training Enhanced with QR-Tagging and 3D Engineering Asset Model," 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022, pp. 466-471, doi: 10.1109/VRW55335.2022.00103.
The full text can be found here
Showcasing Mobile MRI:
Towards More Effective VR-Based Presentations of Real-World Assets: Showcasing Mobile MRI to Medical Practitioners and Technicians
The main aim of this research is to examine the benefits of using VR to present mobile MRI. Even though such devices were specifically designed for mobility, it is still often unfeasible to transport them across long distances. Hence, new methods are required that help familiarize potential patients and medical personnel with the advan-tages and shortcomings of mobile MRI. To do this, we developed a system that transports the user to the VR environment populated with the real-scale MRI model.
S. Tadeja, K. Godula, A. Cybulski, T. Bohné and M. Woźniak, "Towards More Effective VR-Based Presentations of Real-World Assets: Showcasing Mobile MRI to Medical Practitioners and Technicians," 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Shanghai, China, 2023, pp. 183-186, doi: 10.1109/VRW58643.2023.00045.
The full text can be found here