Abstract: The Industry 5.0 paradigm emphasizes the importance of the operator’s well-being by seeing human-centricity as one of its cardinal principles. This enables a twofold benefit, improving the sustainability of the production process and enhancing performance. Improving performance and increasing operators’ safety is often related to cognitive load optimization. Confined spaces are working environments where elements of distraction, such as noise, can cause accidents with major, even fatal, consequences. Studies on the effects of noise on cognitive abilities present mixed results, and those concerning confined spaces are limited as they require an expensive experimental setup replicating the working scenario. Immersive Virtual Reality (IVR) technology enables overcoming this gap by replicating the experimental conditions in a synthetic environment. We exploited IVR to study noise’s impact on cognitive performance in confined spaces. We compared the impact of a stationary continuous noise source with an intermittent non-periodic one by administering the Stroop Color and Word Test. We also assessed the perceived cognitive effort by administering the modified noise-induced task load index questionnaire. We also compared the effects on the operator’s physiological activity through Heart Rate Variability (HRV) analysis. Results show that by keeping the equivalent noise level lower than 85 dB, noise has no statistically significant effects on cognitive performance and Heart Rate.

Keywords: Cognitive Performance | Heart Rate Variability | Noise Effects | Stroop Color and Word Test | Virtual Reality

Abstract: In recent years, Augmented Reality (AR) has been effectively proposed as a tool to support workers in manual procedural tasks in industry, such as assembly and maintenance. It is very common for workers to deal with complete equipment in maintenance. Then, instructions may refer to components located in blind areas, i.e., visually occluded by part of the equipment. Displaying in-situ AR instructions in such blind areas requires handling occlusions; otherwise, side-by-side instructions can be exploited. In the literature, it is still unclear which solution better leverage workers’ performance in maintenance tasks accomplished in blind areas. Thus, we designed three AR presentation modes to convey maintenance instructions in a real machine: 3D in-situ rendered with X-ray technique; 3D side-by-side on a CAD model replicating the blind area; 2D side-by-side on a virtual mirror. We conducted a user study comparing these three presentation modes with a 2D drawing extracted from the original maintenance documentation of the machine. The performance of 42 participants was evaluated in terms of completion time, accuracy, and cognitive load. The results revealed that both in-situ and 3D side-by-side presentation modes perform better than 2D drawing. Specifically, the in-situ presentation mode outperforms the 3D side-by-side mode in terms of completion time. The side-by-side virtual mirror does not improve performance with respect to 2D drawing, then it needs to be redesigned for effective use in AR maintenance interfaces.

Keywords: Augmented reality | Blind area | Industrial operator support | Maintenance | Occlusion | Work instructions

Abstract: Augmented Reality (AR) has been proved to be effective in maintenance operations in the industrial field. In a concurrent engineering approach, the authoring of AR manuals, to convey instructions to operators exploiting AR, must be done during the design phase of the product lifecycle. A reliable solution is needed to speed up the AR manual development process when the product is not physically available. We compared three solutions for displaying a demo version of an AR manual when the real product is not available, opting to replace it with its CAD model. Based on the user study results, the main features for each demo version were collected. The Augmented Reality (AR) solution allows to show the product that is not physically available in a real scale with the drawback of needing a physical printed marker. The Desktop Virtual Reality (DVR) prototype overcomes the problem of managing different devices and real-life locations, but without a real scale and a natural interaction. The Augmented Desktop Virtual Reality (ADVR) prototype allows to distinguish more easily the virtual elements of the true AR from those simulating the real product, but with a less natural interaction due to the use of a secondary screen. As a case study, we chose a compressor that a local company is going to produce with its AR manual. Although users overall preferred the AR demo version, the company chose the ADVR solution due to a better perception of what would be the result of the true AR application.

Keywords: Augmented Reality | Prototyping | Task simulation | Work instructions

Abstract: This work is part of a larger project aiming to develop a comprehensive Augmented Reality (AR) interface for recreative and professional nautical sailing navigation. Due to the complexity of the marine environment and the dynamism of the crew members on board, we propose to diversify the display of navigation information concerning the role, position and activity onboard. The interfaces are designed to be viewed by one or more crew members, solving the problem of everyone viewing the same data, and giving each one the information they need based on their role or position. The three novel proposals for sail-specific AR graphic interfaces are designed to be displayed on Head-Mounted Display HMD and each of them differs for the information stabilization: Screen-Stabilized, Body-Stabilized and Boat-Stabilized. Each interface is different from the others differentiated according to the type of navigation and the user who must use that information. These approaches have been prototyped and evaluated by a panel of experts in the field of sailing navigation and were able to showcase their potential for future evaluations in different scenarios.

Keywords: Augmented Reality | Interface | Nautical | Sailing | Spatiality | User-based

Abstract: Confined spaces cause fatal and serious injuries that tragically recur with similar dynamics every year. A survey carried out on the Italian territory by the National Institute for Insurance against Accidents at Work on the years from 2001 to 2019 shows that a total of 184 accidents occurred in confined spaces mostly because workers were poorly informed and trained, the risk assessment lacking, and that the provisions of the law were not respected. Often fatal events affect those involved in the primary incident and those who intervene in an attempt to assist. Consequently, it is necessary to apply a proper training process and extend it to all those involved in operations both inside and next to confined spaces. Traditionally, the training approach consists of classroom lectures and simulations in real environments. However, real simulation scenarios are costly and time-consuming as real scenarios training simulations require expensive purpose-built physical simulators. To overcome these limitations, we designed and implemented an Immersive Virtual Reality based platform to support and enforce the traditional confined space safety training approach. Finally, we defined an experimental validation procedure.

Keywords: Confined spaces | Immersive Virtual Reality | Safety training | Usability | Work safety

Abstract: With the high growth and prosperity of e-commerce, the retail industry needs to explore new technologies that improve digital shopping experiences. In the current technological scenario, Virtual Reality (VR) emerges as a tool and an opportunity for enhancing shopping activities, especially for the fashion industry. This study explores whether using Immersive Virtual Reality (IVR) technologies enhances the shopping experience in the fashion industry compared to Desktop Virtual Reality (DVR). A within-subject experiment was carried out involving a sample of 60 participants who completed a simulated shopping experience. In the first mode (DVR), a desktop computer setup was used to test the shopping experience using a mouse and keyboard for navigation. The second mode (IVR) exploited a Head-Mounted Display (HMD), and controllers, that allowed navigation while seated on a workstation to avoid sickness. Participants had to find a bag in the virtual shop and explore its features until they were ready to purchase it. Post-hoc measures of time duration of the shopping experience, hedonic and utilitarian values, user experience, and cognitive load were compared. Results showed that participants experienced higher hedonism and utilitarianism in the IVR shop compared to DVR. The cognitive load was comparable in both modes, while user experience was higher in IVR. In addition, the time duration of the shopping experience was higher in IVR, where users stayed immersed and enjoyed it for longer. This study has implications for fashion industry research, as the use of IVR can potentially lead to novel shopping patterns by enhancing the shopping experience.

Keywords: Fashion industry | Retailing | Shopping experience | User study | Virtual reality

Abstract: In this work, we propose a Mixed Reality (MR) application to support laboratory lectures in STEM distance education. It was designed following a methodology extendable to diverse STEM laboratory lectures. We formulated this methodology considering the main issues found in the literature that limit MR’s use in education. Thus, the main design features of the resulting MR application are students’ and teachers’ involvement, use of not distracting graphics, integration of traditional didactic material, and easy scalability to new learning activities. In this work, we present how we applied the design methodology and used the framework for the case study of an engineering course to support students in understanding drawings of complex machines without being physically in the laboratory. We finally evaluated the usability and cognitive load of the implemented MR application through two user studies, involving, respectively, 48 and 36 students. The results reveal that the usability of our application is “excellent” (mean SUS score 84.7), and it is not influenced by familiarity with Mixed Reality and distance education tools. Furthermore, the cognitive load is medium (mean NASA TLX score below 29) for all four learning tasks that students can accomplish through the MR application.

Keywords: augmented and virtual reality | distance education and online learning | improving classroom teaching | mixed reality | mobile learning

Abstract: Industrial Augmented Reality (iAR) has demonstrated its advantages to communicate technical information in the fields of maintenance, assembly, and training. However, literature is scattered among different visual assets (i.e., AR visual user interface elements associated with a real scene). In this work, we present a systematic literature review of visual assets used in these industrial fields. We searched five databases, initially finding 1757 papers. Then, we selected 122 iAR papers from 1997 to 2019 and extracted 348 visual assets. We propose a classification for visual assets according to (i) what is displayed, (ii) how it conveys information (frame of reference, color coding, animation), and, (iii) why it is used. Our review shows that product models, text and auxiliary models are, in order, the most common, with each most often used to support operating, checking and locating tasks respectively. Other visual assets are scarcely used. Product and auxiliary models are commonly rendered world-fixed, color coding is not used as often as expected, while animations are limited to product and auxiliary model. This survey provides a snapshot of over 20 years of literature in iAR, useful to understand established practices to orientate in iAR interface design and to present future research directions.

Keywords: Augmented reality | industry | reviews | user interfaces | visualization

Abstract: Industry 4.0 is characterized by great potential for innovation impacting the operator's role, increasingly engaged in smart activities of a decision-making nature. In such a working scenario, operators' working conditions can be effectively improved by applying a user-centered collaborative design approach. To this end, we developed a Virtual Reality-based multiplayer tool exploiting low-cost body tracking technology to evaluate ergonomic postural risk. The tool allows evaluating both in real-time and off-line the ergonomic postural risk according to the Rapid Upper Limb Assessment metrics. By applying this approach, a twofold advantage can be achieved. On the one hand, ergonomic experts can have an immersive three-dimensional visualization of postures even in off-line observations. On the other hand, it is possible to evaluate the ergonomics of workstations in the design phase by having the operator work on virtual mock-ups of workstations, thus allowing a sustainable approach to user-centered collaborative design.

Keywords: Collaborative design | Ergonomics | Kinect V2 | RULA | User-centered | Virtual Reality

Abstract: Although Virtual Reality Social Skills Training has proven its effectiveness in treating psychiatric disorders, this VR application field is still under-researched for two main reasons. The first one is the unavailability of low-cost VR technologies with sufficient computational capacity needed to render realistic Virtual Environments. The second one consists of the need for specialized VR application developers, usually far from the mental health research field. The recent diffusion of low-cost stereoscopic viewers and the introduction of easy and fast VR content authoring systems, such as Cinematic Virtual Reality (CVR), allow overcoming these limitations. CVR makes it possible to capture real scenes through 360 cameras, augment them with additional virtual objects, and finally immerse the user in these synthetic but highly immersive environments. We present the design and the features of the Entellect360 prototype -an innovative tool supporting the rehabilitation process of subjects affected by schizophrenia. It exploits CVR technology to create Virtual Environments aimed at the rehabilitation of psychiatric patients. The Entellect360 features allow for rehabilitation sessions and patient-performance data-collection even under conditions of social distancing. We also explain the experimental protocol and the validation procedure the prototype will undergo to assess its effectiveness.

Keywords: 360-degree virtual reality | Cognitive rehabilitation | Human-computer interaction | Mental health | Social skills training

Abstract: The introduction of the new generation of Head Mounted Displays (HMD) makes users’ experiences in Mixed Reality (MR) environments more engaging. However, these devices still have a limited field of view, which negatively affects the spatial localization process of virtual objects in the 3D environment. The literature presents several visualization techniques to address this issue, but they currently have several drawbacks, such as visual clutter, occlusion of the real scene, high user workload, and there is still no visualization technique that solves such issues definitively. Therefore, inspired by the gaming industry, we present CompassbAR a visualization technique for out-of-view objects. CompassbAR encodes the position of all out-of-view objects surrounding the user, in a 2D bar positioned at the top of the field of view. In addition, we propose a validation procedure and metrics that aim to evaluate the ability of the CompassbAR visualization technique to guide users towards the out-of-view objects.

Keywords: Head-mounted display | Mixed Reality | Visualization techniques

Abstract: Mixed Reality (MR) could help students in the understanding of complex concepts as well as increase their motivation in the learning process. In this work, our aim is to propose a MR application for the support of engineering students in the understanding of assembly drawings of complex machines. We presented the application of our design methodology for this case study. Then, based on the results of a user study with a sample of students, we tried to improve the usability and the user experience of the MR application, proposing an updated version. The usability of the revised application was in the range “good-excellent” (mean SUS score 77.0). We also presented the lessons learned in this case study, that can be a starting point for a renewal of consolidated didactic processes aiming at future application of MR in other STEM courses.

Keywords: Augmented and virtual reality | Distance education and online learning | Improving classroom teaching | Mixed Reality | Mobile learning

Abstract: Sailing navigation is an activity that requires acquiring and processing information from the surrounding environment. The advancement of technology has enabled sailboats to have an increasing number of onboard sensors that make sailing more user-friendly. However, data provided by these sensors are still visualized on 2D digital displays that imitate traditional analog interfaces. Although these displays are strategically placed on the sailboat, the user needs to divert attention from the primary navigation task to look at them, thus spending a significant amount of cognitive resources. AR-based technologies have the potential to overcome these limitations by displaying information registered in the real environment, but there are no studies in the literature for validating the effectiveness of this technology in the field of sailing. Thus, we designed a head-mounted display AR-based interface to assist users in monitoring wind data to avoid user diversion from the primary task of sailing. We conducted a user study involving 45 participants in an Immersive Virtual Reality simulated environment. We collected objective and subjective measures to compare the AR-based interface with a traditional data visualization system. The AR-based interface outperformed the traditional data visualization system regarding reaction time, cognitive load, system usability, and user experience.

Keywords: Augmented reality | Cognitive load | Human–computer interaction | Nautical | Sailing | User study

Abstract: In the future, many activities will be carried out in the Metaverse: hybrid offices and video-based education are just some examples. The way research is carried out could change, too. In this context, this work investigates the possibility of simulating Augmented Reality (AR) user studies on information presentation in a virtual environment. Organizing an industrial setup is complex; thus, most studies are executed in laboratories. However, lab experiments present limitations, e.g., the number and variety of participants and the availability of facilities. User studies may also be carried out by exploiting simulated AR, as an initial step for the Metaverse, where people are connected regardless of their location. This alternative could be used to carry out experiments on AR information presentation to solve common issues, such as the lack of physical equipment to perform component location tasks and the long time required to collect a large sample of users. Indeed, researchers could propose CAD models with information that simulates the same visual realism achieved with true AR. Moreover, multiple tests could be conducted in parallel by not relying on a limited amount of physical equipment per user. In this work, we developed and evaluated a desktop-simulated testing environment (DSTE) to conduct AR information presentation experiments remotely. We applied it in a pilot user study, revealing that the proposed DSTE was effective for the related research goals. Furthermore, 40 participants reported a positive user experience. The evaluation confirms that using a DSTE is promising for collecting and analyzing data from a wide range of people.

Keywords: AR simulation | industrial metaverse | information presentation | user interaction | user study

Abstract: The choice of furniture in a retail store is usually based on a product catalog and simplistic product renderings with different configurations. We present a preliminary field study that tests a Multi-Sensory In-Store Virtual Reality Customer Journey (MSISVRCJ) through a virtual catalog and a product configurator to support furnishings sales. The system allows customers to stay immersed in the virtual environment (VE) while the sales expert changes the colors, textures, and finishes of the furniture, also exploring different VEs. In addition, customers can experience realistic tactile feedback with in-store samples of furniture they can test. The journey is implemented for a furniture manufacturer and tested in a flagship store. Fifty real customers show positive feedback in terms of general satisfaction, perceived realism, and acceptance. This method can increase purchase confidence, reduce entrepreneurial costs, and leverage in-store versus online shopping.

Keywords: customer journey | furniture | in-store | industrial design | multisensory | retailing | virtual reality

Abstract: Objectives: This study aims to evaluate the acceptability of Cinematic VR technology as a novel therapeutic approach supporting Social Skills Training (SST) rehabilitation interventions among patients with schizophrenia. Materials and Methods: We developed an innovative cinematic VR-based platform as a support system for SST rehabilitation of independent living skills and evaluated its acceptance among psychiatric patients in terms of usability, user experience, and use performance. Ten voluntary participants were enrolled in the study. The study inclusion criteria consisted of age 18-65 years, lack of moderate and severe intellectual disability, no substance use disorder, and schizophrenia spectrum disorder pathology according to DSM V. We administered post treatment questionnaires and developed the platform to capture relevant data automatically. Results: Patients rated usability and user experience from good to excellent. We also observed an improvement in the use performance. Conclusions: Cinematic Virtual Reality based applications showed good acceptability among patients with schizophrenia. This result supports further efforts in evaluating its effectiveness as a novel therapeutic approach supporting SST rehabilitation interventions.

Keywords: Cinematic virtual reality | Schizophrenia rehabilitation | Social skills training | Task performance | Usability | User experience

Abstract: Immersive Vimial Reality (IVR) training offers the capability to industrial workers to acquire skills and address complex tasks by immersing them in a safe and controlled virtual environment (VE). However, in the literature, IVR training is mainly based on principles of standardization and efficiency without considering the operators' well-being. A novel design approach consists of the introduction in the VE of Positive Computing to improve workers' well-being by applying the Biophilia hypothesis. In this work, we explored the possibility of introducing biophilic elements in a VE training scenario that would support psychological well-being and human potential. However, the introduction of virtual elements not related to the training task may distract operators, impairing their performance. We selected as a training scenario the assembly of a real truck engine. It is accomplished in a workstation, and operators do not interact with the surrounding VE. Therefore, we placed the training area into four different types of VEs: 3D Minimal (MIN), 3D Minimal Biophilic enriched (MIN+BIO), 3D Realistic (REAL), and 3D Realistic Biophilic enriched (REAL+BIO). We compared the MIN and REAL scenarios with the respective biophilic enriched scenarios. The performance of 40 participants was evaluated in terms of completion time, object fixation time, training task accuracy, knowledge accuracy, cognitive load, and user experience. The results revealed that introducing biophilic elements in a VR training environment attracts users' attention in the idle phase of the training. In contrast, they keep concentrating on the task without worsening their performance during the task accomplishment

Keywords: Biophilia Hypothesis | Industrial Training | Positive Computing | Virtual Reality

Abstract: As noise is a pervasive element of work environments, it could affect workers' performance and wellbeing. In particular environments, such as confined spaces, noise could represent an even greater disruptor because reverberation effects amplify exposure levels and could affect cognitive abilities. The study of the effects of noise has mixed results in the literature and was scarcely investigated with reference to this application scenario. Nowadays, Immersive Virtual Reality (IVR) can simulate in a realistic way the working conditions in these environments and consequently simplify the investigations in this field that otherwise would be expensive and difficult to implement for safety reasons. In this work, we verify the ability of a current high-end IVR system to reproduce the acoustic conditions of a confined space realistically, and we evaluate the effects on user cognitive performance and user-perceived workload of a noise source typical of these industrial working environments.

Keywords: immersive virtual reality | N-back test | noise effects | NOISE-TLX | user experience | user performance

Abstract: The definition of an innovative category of implantable devices, characterized not only by a fully customization but also by improved osteoconductive and functionalized bioactive surfaces, needs to be supported by a systematic approach. In the present work, a new human-machine interface based on the Mixed Reality (MR) is proposed and focused on the implantation of a fully customized prosthesis. By means of an informal and exploratory focus group (i.e., without using a structured questionnaire), the limitations belonging to the current procedure were highlighted and a first list of user needs was subsequently defined. The MR interface was then considered to be the most suitable solution to match the gathered requirements. However, the doctors proposed also to develop a desktop interface for a finer and easier manipulation of 3D models. The proposed MR application offers several advantages from the possibility to display 3D anatomical structures and 3D models of custom prostheses in an immersive environment to the optimized communication and data exchange among the players (medical staff, doctors and engineers). A mock-up of the MR applications is presented in this work to show the results of the design stage, before the deployment of the application.

Keywords: Collaborative Network | Fully Custom Implants | Immersive Environment | Mixed Reality

Abstract: The industrial transition to the 4.0 paradigm defines new scenarios in which the operator plays a central role within the industrial ecosystem. Thanks to the enabling technologies of Industry 4.0, it is possible to effectively improve operators' working conditions by applying the Human-Centered approach. Nowadays, one of the main challenges is to reduce work-related musculoskeletal disorders resulting from ergonomically incorrect working conditions in order to prevent the occurrence of occupational diseases. To this end, we developed a software tool that leverages a low-cost D-RGB camera (Kinect v2) to track the human body and an Augmented Reality (AR) visualization system based on Microsoft HoloLens 2. The tool assesses postural ergonomic risk in real-time according to the Rapid Upper Limb Assessment (RULA) metric. The proposed AR application allows a three-dimensional visualization of postures, which can be observed directly superimposed on the operator's body in the real scene. This approach aims to optimize the understanding of postures by creating a link between real information (operator's body) and virtual information (virtual skeleton, RULA score, and angles) by providing a simple and immediate user interface for ergonomists.

Keywords: Augmented Reality | Ergonomics | Hololens 2 | Human-Centered | Kinect v2 | RULA

Abstract: This study investigates the use of augmented reality technology (AR) in the field of maritime navigation and how researchers and designers have addressed AR data visualisation. The paper presents a systematic review analysing the publication type, the AR device, which information elements are visualised and how, the validation method and technological readiness. Eleven AR maritime solutions identified from scientific papers are studied and discussed in relation to previous navigation tools. It is found that primitive information such as course, compass degrees, boat speed and geographic coordinates continue to be fundamental information to be represented even with AR maritime solutions.

Keywords: augmented reality | data visualisation | human-computer interaction | maritime

Abstract: Today’s sailing visualization instruments struggle to cope with the increasing number of onboard sensors, automation, artificial intelligence, and the high dy-namism of the crew. Current solutions scatter multiple displays all over the boat, both inside and outside, potentially reducing usability and increasing costs. This work presents a systematic review of augmented reality (AR) as an integral solution for sailing data visualization, which revealed four scientific papers and eight commercial products. We analyzed the publication type, the AR hardware, what and how information is presented using AR, the validation method (if present), and the technological readiness. We defined the technical requirements needed for the AR device for sailing and distinguished a first generation of commercial solutions based on head-up displays from a second one based on proper augmentation with stereo head-mounted displays. The displayed information elements are limited in number and are commonly 2-D graphics (e.g., text and symbols) with a screen-relative frame of reference (as opposed to body-or world-relative). The most visu-alized elements are heading (10) followed by wind direction (8), boat speed (7) compass (7), and wind speed (7). We also found that most of the solutions lack critical evaluation. We conclude that AR has the potential to integrate sailing data from different systems and to improve accessibility, situation awareness, and safety for a large group of users. However, the main limitations are the lack of AR head-mounted displays suitable or adaptable for sailing conditions, an extensive exploration of 3-D interface elements, and an adequate number of usability studies in the scientific literature.

Keywords: Augmented reality | Data visualization | Human-computer interaction | Nautical instruments | Sailing

Abstract: This paper presents a novel Augmented Reality (AR) interface for Head Mounted Display HMD, specifically for sailing navigation. Compared to literature and the commercial solutions available, the novelty is to use boat-referenced 3D graphics. It allows representing wind direction and intensity, heading with monochrome green elements. Furthermore, we carried out a user validation study. We implemented a virtual simulator including a sailboat, the marine environment (i.e., sea, sky, marine traffic, and sounds), and the presented interface as AR overlay. We evaluated the effectiveness of the wind representation of the AR interface through an online questionnaire based on a video simulation and asking the user to imagine it as the result of an AR visualization. We defined one test scenario with wind variations and a distracting element (i.e., a crossing vessel). 75 sailors (59% experts, with more than 50 sailing days per year) participated in the questionnaire, and most of them (63%) considered the video effective at simulating the AR interface. In addition, 75% are ready to wear an AR device during sailing. Also, the usability (SUS questionnaire) and the user experience (UEQ) results provided positive results.

Keywords: Augmented reality | Human-computer interaction | Nautical | Sailing | user test

Abstract: The research presented in this contribution aims to investigate user preferences about how to convey information in Industrial Augmented Reality (IAR) interfaces to the user. Our interest is focused on the opinion of potential technical writers of IAR documentation for assembly or maintenance operations. Authoring of IAR interfaces imply a choice among various visual assets, that is influenced by the information type and the AR display used. There are no specific standards in the literature to follow and it is challenging to extract guidelines from the literature. This study gathers preferences of 105 selected users that have knowledge about IAR issues, graphical user interfaces (GUI) designing, and assembly/maintenance procedures. The results of this survey show a great preference for 3D CAD models of components (product model) for almost all the information types. However, some alternative visual assets have also been proposed, such as video and auxiliary models. Contrary to common practices in industry, text was the least preferred visual asset. The insights from this research can help other IAR technical writers in the authoring of their interfaces.

Keywords: Graphic Interface | Industrial Augmented Reality | Manual Assembly | Visual Asset

Abstract: Sailing is a multidisciplinary activity that requires years to master. Recently this sustainable sport is becoming even harder due to the increasing number of onboard sensors, automation, artificial intelligence, and the high performances obtainable with modern vessels and sail designs. Augmented Reality technology (AR) has the potential to assist sailors of all ages and experience level and improve confidence, accessibility, situation awareness, and safety. This work presents our ongoing research and methodology for developing AR assisted sailing. We started with the problem definition followed by a state of the art using a systematic review. Secondly, we elicited the main task and variables using an online questionnaire with experts. Third, we extracted the main variables and conceptualized some visual interfaces using 3 different approaches. As final phase, we designed and implemented a user test platform using a VR headset to simulate AR in different marine scenarios. For a real deployment, we witness the lack of available AR devices, so we are developing one specific headset dedicated to this task. We also envision the possible redesign of the entire boat as a consequence of the introduction of AR technology.

Keywords: Augmented Reality | Human Computer Interaction | Nautical | Sailing | Yacht

Abstract: This paper investigates the Augmented Reality (AR) technology with a novel approach based on patent research. We searched the USPTO for AR-related granted patents in the period 1993–2018, we selected and manually browse a total of 2,373, we classified them in five key technological classes i.e., display device, tracking, user interaction, application, and system, and we finally analyzed the results. The main contribution of this paper is the investigation of the technological trends, with outcomes that can be useful for researchers and developers for technical steering, but also for policymakers, managers and entrepreneurs for technology scouting and forecasting. Our study found that AR technological development has especially increased in the last decade. In particular, we evidenced a remarkable steady of 82 % annual growth rate of the number of granted patents after 2012. From geographical distribution, we found that North America is the leader (68 %); Asia (18 %) and Europe (13 %) are lagging behind despite dedicated Industry 4.0 policies actuated by the governments. Another nontrivial result is the incoherency between the owners of a high quantity of patents and those highly impacting. In fact, only Microsoft Corporation and Amazon Technologies are at the same time in the top 10 of the most patent-intensive organizations and the top 10 of highly impacting organizations. Moreover, the majority of the patents are owned by companies, albeit some of the highly impacting ones come from universities or research centers. These findings provide theoretical, managerial, and policy implications for future research activities in the AR domain.

Keywords: Application | AR systems | Augmented reality | Display device | Geographical distribution | Holograms | Human-machine interaction | Immersive technologies | Industry 4.0 | Interactive technologies | Patent analysis | Presence | Review | Technological innovation | Technological trend | Technology forecasting | Technology scouting | Tracking | User interaction | Visual overlay

Abstract: Technical documentation is evolving from static contents presented on paper or via digital publishing to real-time on-demand contents displayed via virtual and augmented reality (AR) devices. However, how best to provide personalized and context-relevant presentation of technical information is still an open field of research. In particular, the systems described in the literature can manage a limited number of modalities to convey technical information, and do not consider the 'people' factor. Then, in this work, we present a Context-Aware Technical Information Management (CATIM) system, that dynamically manages (1) what information as well as (2) how information is presented in an augmented reality interface. The system was successfully implemented, and we made a first evaluation in the real industrial scenario of the maintenance of a hydraulic valve. We also measured the time performance of the system, and results revealed that CATIM performs fast enough to support interactive AR.

Keywords: Augmented reality | Context-aware | Human-centered design | Human-computer interaction | Industrial | Information manager | Maintenance | Technical documentation

Abstract: The enabling technologies of the Industry 4.0 program can support the smart factory of the future to face the challenges related to their sustainable growth. In particular, given the progressive ageing of the population, it is mandatory to develop systems able to preserve operators' wellbeing and to prevent the incidence of work-related musculoskeletal disorders. By exploiting a recently introduced low-cost sensor we developed and validated a reliable prototype for automatic assessment of ergonomic postural risk in the factory shopfloor. Encouraged by the results of the validation process, we enhanced the prototype functionalities. The tool will serve both as a monitoring system for the evaluation of postural risk and a training system for increasing operators' awareness. In this paper, we describe the design of the prototype and the enhanced functionalities of the final version, - the ErgoSentinel.

Keywords: Ergonomics | I4.0 | Kinect® V2 | Postural risk assessment | RULA | Sustainable work

Abstract: Augmented Reality is considered one of the most promising technologies for Industry 4.0. Augmented Reality allows to display the needed information at the right time and to locate it in the desired space, superimposing it to the real world. In this way, it could simplify the work of industrial operators in a variety of tasks, from planning and commissioning to assembly and maintenance. Despite the growing research interest and efforts for the development of Augmented Reality applications and technologies for the industrial domain, Augmented Reality is still rarely used in real industrial procedures, often remaining at a conceptual level. In fact, developers fail to completely answer the actual needs of industries and workers because of a lack of knowledge of the context and the absence of guidelines to drive the design and development of Augmented Reality applications. One of the open issues is the choice of the proper visualization methods to display technical information in Augmented Reality, which is not trivial. Both the paper-based documentation, based on text and illustrations, and digital documentation, including CAD models and image or video-based tutorials, present different criticalities when adapted to the Augmented Reality technology. Other visual material has been developed specifically to be used in Augmented Reality, but it is difficult to use because of a lack of standards which are instead present for the former paper-based and digital documentation. In this work, we categorize and compare different Augmented Reality visual assets, illustrating their advantages and disadvantages and providing directions for future research.

Keywords: Augmented Reality | Graphical User Interface | Industry 4.0 | Technical documentation

Abstract: A number of studies have recently demonstrated that the geometry of scaffolds for bone tissue engineering significantly affects the tissue differentiation process and the rate of bone tissue regeneration. These findings and the possibility of fabricating any kind of sophisticated geometries by additive manufacturing techniques led many researchers throughout the world to investigate strategies for the design of scaffolds and for the optimization of their geometry. In this chapter, after revising the numerical optimization algorithms recently implemented to determine the best scaffold geometry we will investigate, in particular, those that are mechanobiology-driven. These algorithms perturb the scaffold microarchitecture until the optimal scaffold geometry, i.e., the geometry that allows maximizing the amounts of bone forming within the scaffold pores, is computed. Different applications of these algorithms to different regular and irregular scaffold geometries will be shown.

Keywords: Beam-based scaffold | Irregular scaffold | Mechanobiology | Mechanoregulation algorithm | Regular scaffold

Abstract: Technical information presentation is evolving from static contents presented on paper or via digital publishing to real-time context-aware contents displayed via virtual and augmented reality devices. We present a Context-Aware Technical Information Management system (CATIM), that dynamically manages (1) what information as well as (2) how information is presented in an augmented reality interface. CATIM acquires context data about activity, operator, and environment, and then based on these data, proposes a dynamic augmented reality output tailored to the current context. The system was successfully implemented and preliminarily evaluated in a case study regarding the maintenance of a hydraulic valve.

Keywords: Aware information | Context | Industrial augmented reality | Technical information manager

Abstract: In this work, we present an Augmented Reality (AR) application for handheld devices that support operators in information retrieval tasks in maintenance procedures in the context of Industry 4.0. Indeed, using AR allows the integration of knowledge-based information, traditionally used by operators and mainly provided in the form of technical drawings, and data available from sensors on the equipment. This approach is suggested by companies, especially Small and Medium-sized Enterprises, that want a gradual introduction of Industry 4.0 technologies within their established practices. We implemented a prototype of the application for the case study of a milling plant. The application augments on a Piping and Instrumentation Diagram (P&ID) of the plant some virtual interactive graphics (hotspots) referenced to specific components drawn. Component data are retrieved, through a user interface, directly from the factory database and displayed on the screen. We evaluated the application through a user study aimed at comparing the AR application with the current practice, based on paper documentation, for an information retrieval task within a maintenance procedure. Results of the study revealed that AR is effective for this task in terms of task time reduction and usability. The AR application was tested both with a tablet and a smartphone, but results revealed that using tablet does not improve user performance in terms of task time, error rate, and usability.

Keywords: Augmented Reality | Industry 4.0 | Information retrieval | Maintenance | User evaluation