Abstract: Objective and reliable assessment of motor functions, such as dexterity, is a key point for evaluating worker’s abilities. In this context, the proposed work presents a tool for objective automatic assessment of the Minnesota Dexterity Test using cameras with depth sensors. Typical performance measurements (i.e., total time and associated percentiles) were estimated using custom algorithms. In addition, the possibility to identify the qualifiers for the code d440 of the International Classification of Functioning, Disability and Health was implemented in the developed algorithms. The proposed tool can also identify the mistakes most frequently committed by the subjects. To prove the capabilities of the proposed method, a series of experimental trials was conducted with 10 healthy young volunteers. Results showed that the developed tool helps clinicians to obtain performance feedback and evaluate patients’ dexterity quickly without bias.

Keywords: Automatic assessment | Biomechanics | Depth cameras | Manual dexterity | Motion capture

Abstract: Collaborative robots (cobots) are designed to directly interact with human beings within a shared workspace. To minimize the risk of musculoskeletal disease for the workers, a physical ergonomic assessment of their interaction is needed. Virtual reality (VR) and motion capture (Mocap) systems can aid designers in building low-hazard collaborative environments. This work presents a framework based on VR and Mocap systems for the ergonomic evaluation of collaborative robotic workstations. Starting from the 3D models of the cobot and workstation components, a virtual environment is built in Unity and ROS is employed to manage the cobot behavior. The physical ergonomics is evaluated by means of RULA methodology, exploiting the body tracking capabilities of the device Kinect Azure, a low-cost markerless Mocap system. The framework has been tested by building a virtual environment for collaborative control of flanges with different diameters. The worker interacts with a six-axis Nyro One to move parts on the workstation. The ergonomic assessment is performed in real-time, and a report is generated for later uses and evaluations. The proposed framework fosters the design of collaborative robotics workstations based on an objective assessment of ergonomics. The results of this research work allow planning future development steps for the emulation of more complex workstations with cobots and the use of augmented reality to evaluate how to modify existing workstations to introduce a cobot.

Keywords: Collaborative robots | Ergonomics | Motion capture | Virtual reality

Abstract: Nowadays, Search and Rescue operations can be performed using manned or unmanned Aerial Vehicles. In this latter case, compact cameras are mounted onboard and a bird’s eye view is available to find the missing person. However, the analysis of the video frames can be very challenging and dull for the operators. In this context, the use of graphical methodologies can boost the searching operations and improve the process. In this study, a methodology based on the object detector Yolov5 is introduced: the performances in detecting small objects such as persons in aerial images are evaluated. These algorithms implement shallow layers of the feature extractor to increase the spatial-rich features and help the detector to find small objects. Finally, detection algorithms are tested using a video simulating a scenario for Search and Rescue operations. The filtering of frames containing false positives, is carried out using a classical graphical tool such as the Hamming distance.

Keywords: Aerial images | Graphical methodologies | Image analysis | Object detection | SAR operations

Abstract: Anomaly detection is the identification of any event that falls outside what is considered ‘acceptable behaviour’. This work investigates anomaly detection for automated visual inspection in the context of industry automation (‘Industry 4.0’). For this task we propose a machine vision procedure based on visual feature extraction and one-class k nearest neighbours classification. The method requires only samples of normal (non-defective) instances for the training step. We benchmarked our approach using seven traditional (‘hand-designed’) colour texture descriptors and five pre-trained convolutional neural networks (CNN) ‘off-the-shelf’. Experimenting on nine image datasets from seven classes of materials (carpet, concrete, fabric, layered fused filament, leather, paper and wood), each containing normal and abnormal samples, we found overall accuracy in the range 82.0%–90.2%. Convolutional networks off-the-shelf performed generally better than the traditional methods, although – interestingly – this was not true for all the datasets considered. No visual descriptor clearly emerged as the all-purpose best option.

Keywords: Anomaly detection | Colour | Convolutional neural networks | Texture | Visual descriptors

Abstract: Background and Objective:In biomedical fields, image analysis is often necessary for an accurate diagnosis. In order to obtain all the information needed to form an in-depth clinical picture, it may be useful to combine the contents of images taken under different diagnostic modes. Multimodal medical image fusion techniques enable complementary information acquired by different imaging devices to be automatically combined into a unique image. Methods:In this paper, multimodal medical images fusion method based on multiresolution analysis (MRA) is proposed, with the aim to combine the high geometric content of magnetic resonance imaging (MRI) and the elasticity information of magnetic resonance elastography (MRE), simultaneously acquired on the same organs of a patient. First, the slices of MRE are volumetrically interpolated to exactly overlap, each with a slice of MRI. Then, the spatial details of MRI are extracted by means of MRA and injected into the corresponding slices of MRE. Due to the intrinsic dissimilarity between corresponding slices of MRE and MRI, the spatial details of MRI are modulated by local or global matching functions. Results:The performance of the proposed method is quantitatively assessed considering radiometric and geometric consistency of the fused images with respect to their originals, in a comparison with two popular methods from the literature. For a qualitative evaluation, a visual inspection is carried out. Conclusions:The results show that the proposed method enables an effective MRI-MRE fusion that allows the elasticity information and geometric details of the examined organs to be evaluated in a single image.

Keywords: Biomedical images | Image processing | Magnetic resonance elastography | Multimodal fusion | Multiresolution analysis | Tomographic sequences

Abstract: In the Cultural Heritage field, the choice of materials and exhibit structures is essential to properly house and support artifacts without causing damage or deterioration. This problem is even more evident in the case of finds made of stone for which, due to their weight, a proper selection and dimensioning of the relative supports is required. In fact, without adequate support, this can result in stress concentrations that could compromise the artifact's state of conservation. As a consequence, more often such exhibition supports are customized items, that are designed and manufactured to meet specific functional and artistic setup needs. In this context, the paper presents a design approach that combines topology optimization and additive manufacturing techniques to develop customized support structures which undertake the twofold purpose of preserving the artifact and making it available for the exhibition in the museum. The proposed approach has been assessed through the case study of a sandstone Ionic capital hosted in the Brettii & Enotri Museum in Cosenza (Italy). The proposed approach is therefore meant as a guideline for the design of customized exhibit supports especially in the case of sandstone artifacts with a complex shape or a conservation condition that requires specific attention.

Keywords: Additive manufacturing | Cultural heritage | Design methods | Exhibit supports | Photogrammetry | Topology optimization

Abstract: This paper introduces a system that enable the collection of relevant data related to the emotional behavior and attention of both student and professor during exams. It exploits facial coding techniques to enable the collection of a large amount of data from the automatic analysis of students and professors faces using video analysis, advanced techniques for gaze tracking based on deep Learning, and technologies and the principles related to the Affective Computing branch derived from the research of Paul Ekman. It provides tools that facilitates the interpretation of the collected data by means of a dashboard. A preliminary experiment has been carried out to investigate whether such a system may help in assessing the evaluation setting and support reflection on the evaluation processes in the light of the different situations, so as to improve the adoption of inclusive approaches. Results suggest that information provided by the proposed system can be helpful in assessing the setting and the evaluation process.

Keywords: Affective computing | Deep learning | E-leaning | Emotion recognition | Gaze tracking

Abstract: Facial appearance is one prominent feature in analyzing several aspects, e.g., aesthetics and expression of emotions, and face analysis is crucial in many fields. Face analysis requires measurements that can be performed by different technologies and typically relies on landmarks identification. Recently, low-cost customer grade 3D cameras have been introduced in the market, enabling an increase of application at affordable cost with nominal adequate performances. Novel cameras require to be thoroughly metrologically characterized to guarantee these performances. Cameras are calibrated following a standard general-purpose procedure. However, the specificity of facial measurements requires a task-based metrological characterization to include typical influence factors. This work outlines a methodology for task-based metrological characterization of low-cost 3D cameras for facial analysis, consisting of: influence factor identification by ANOVA, related uncertainty contribution assessment, uncertainty propagation, landmarking uncertainty estimation. The proposed methodology is then demonstrated on a customer grade state-of-the-art 3D camera available on the market.

Keywords: Depth cameras | Face analysis | Human-machine interaction | Machine vision | Measurement uncertainty | Soft tissue landmarks

Abstract: A low-speed stereo-camera DIC setup was used in this paper to measure the down-sampled bandpass vibration signal of a plate in a given frequency range, which is much higher than the available frame rate. Down-sampled vibration measurements are well known in the literature. However, they are always subject to the strong hypothesis of having a single frequency component in the excitation source (e.g., pure sinusoidal excitation). In this scenario, several approaches can be found in the literature to reconstruct the actual response from the down-sampled data. In this paper, a data postprocessing algorithm is newly introduced to properly reconstruct the target response in the case of a frequency band excitation, thus relaxing the single frequency excitation constraint and allowing to explore a given frequency range with a single measurement. Additionally, a custom excitation signal is presented in this paper to achieve a constant intensity in the studied frequency range. The proposed approach is presented and experimentally validated by measuring a cantilever plate vibration in the kHz range using a 100 fps acquisition. A single acquisition of 98 frames allowed to describe the deformed shapes at 49 different frequency values in the range 1110–1160 Hz, highlighting two resonance peaks. The comparison with the results of multiple conventional single-frequency tests and LDV measurements confirmed the effectiveness of the proposed approach.

Keywords: Digital image correlation | Down-sampled bandpass measurement | Frequency band excitation | Low-speed camera | Vibration measurement

Abstract: The digital image correlation (DIC) was used in this paper to obtain full-field measurements of a target vibrating at a frequency higher than the maximum cameras’ frame rate. The down-sampling technique was implemented to compensate for the cameras’ moderate frame rate, thus getting an accurate displacement acquisition even at 6.5 kHz. Two innovative methods to support the DIC application were introduced. The use of fringe projection (or structured light), initially applied on the sample at rest, reduced the effort and time required for the stereo matching task's solution and improved this setting's accuracy and reliability. Additionally, a new time-domain image filtering was proposed and tested to improve the quality of the obtained DIC maps. In combination with the down-sampling, the effect of this filtering technique was tested in this work at (approx.) 2500 and 6500 Hz by measuring the response of a bladed disk to sinusoidal excitation. Evidence of improved results was observed for both frequencies for amplitudes in the range of 10 µm.

Keywords: Bladed disk | Digital image correlation | Down-sampling approach | Low-speed camera | Reverse engineering | Vibration measurement

Abstract: Shearlet is a multi-dimensional function used for sparse representation, which has many excellent characteristics such as multi-resolution and multi-direction. It can detect the position of singular points and the direction of singular curves, and is more sensitive to the geometric structure of the image. Therefore, this paper introduces the shearlet transform and its application in image processing, and introduces the bendlet transform proposed on this basis.

Keywords: Bendlet | Image processing | Shearlet | Transform

Abstract: Emotion recognition through machine learning techniques is a widely investigated research field, however the recent obligation to wear a face mask, following the COVID19 health emergency, precludes the application of systems developed so far. Humans naturally communicate their emotions through the mouth; therefore, the intelligent systems developed to date for identifying emotions of a subject primarily rely on this area in addition to other anatomical features (eyes, forehead, etc.). However, if the subject is wearing a face mask this region is no longer visible. For this reason, the goal of this work is to develop a tool able to compensate for this shortfall. The proposed tool uses the AffectNet dataset which is composed of eight class of emotions. The iterative training strategy relies on well-known convolutional neural network architectures to identify five sub-classes of emotions: following a pre-processing phase the architecture is trained to perform the task on the eight-class dataset, which is then recategorized into five classes allowing to obtain 96.92% of accuracy on the testing set. This strategy is compared to the most frequently used learning strategies and finally integrated within a real time application that allows to detect faces within a frame, determine if the subjects are wearing a face mask and recognize for each one the current emotion.

Keywords: Artificial intelligence | COVID19 | Emotion recognition | Facial Expression Recognition | Grad-CAM | Non-verbal communication

Abstract: This paper introduces a web-platform system that performs semi-automatic compute of several risk indexes, based on the considered evaluation method (e.g., RULA—Rapid Upper Limb Assessment, REBA—Rapid Entire Body Assessment, OCRA—OCcupational Repetitive Action) to support ergonomics risk estimation, and provides augmented analytics to proactively improve ergonomic risk monitoring based on the characteristics of workers (e.g., age, gender), working tasks, and environment. It implements a body detection system, marker-less and low cost, based on the use of RGB cameras, which exploits the open-source deep learning model CMU (Carnegie Mellon University), from the tf-pose-estimation project, assuring worker privacy and data protection, which has been already successfully assessed in standard laboratory conditions. The paper provides a full description of the proposed platform and reports the results of validation in a real industrial case study regarding a washing machine assembly line composed by 5 workstations. A total of 15 workers have been involved. Results suggest how the proposed system is able to significantly speed up the ergonomic assessment and to predict angles and perform a RULA and OCRA analysis, with an accuracy comparable to that obtainable from a manual analysis, even under the unpredictable conditions that can be found in a real working environment.

Keywords: Ergonomics risk assessment | Extended reality | Human-centered manufacturing | Machine learning | Motion capture

Abstract: A major challenge in the field of Augmented Reality (AR) is the way in which augmented information is presented in a wide range of uncontrollable environmental conditions. In fact, the variability of colours and illumination conditions of the real environment makes it difficult to choose the most suitable appearance properties for augmented contents. In many AR applications, the colours of virtual objects play a crucial role in blending digital information into the real environment, therefore these colours should be selected according to the appearance of the real background. In some use cases, the colours of virtual objects need to be harmonised with the ones of the real environment; in other cases, the colours should be chosen to ensure the visibility (e.g. maximizing the contrast) of the augmented data with respect to the background. To this end, the paper presents a background-aware colourisation technique that allows for selecting virtual objects' colours in accordance with the real environment in real-time. Given an arbitrary real background, virtual objects' colours are automatically chosen according to three different strategies, i.e. harmonic, disharmonic, and balanced. The proposed AR colourisation technique was assessed with a user study that focused on three different case studies. The results were promising and suggest the potential of the proposed technique for many different application areas. In particular, disharmonic and balanced strategies ensured the distinctiveness of virtual objects according to the real background. Instead, the harmonic strategy was less effective in the case of colourful complex AR scenarios.

Keywords: Augmented reality | colour harmonisation | colourisation | image processing | user studies

Abstract: Colour and texture are two perceptual stimuli that determine, to a great extent, the appearance of objects, materials and scenes. The ability to process texture and colour is a fundamental skill in humans as well as in animals; therefore, reproducing such capacity in artificial (‘intelligent’) systems has attracted considerable research attention since the early 70s. Whereas the main approach to the problem was essentially theory-driven (‘hand-crafted’) up to not long ago, in recent years the focus has moved towards data-driven solutions (deep learning). In this overview we retrace the key ideas and methods that have accompanied the evolution of colour and texture analysis over the last five decades, from the ‘early years’ to convolutional networks. Specifically, we review geometric, differential, statistical and rank-based approaches. Advantages and disadvantages of traditional methods vs. deep learning are also critically discussed, including a perspective on which traditional methods have already been subsumed by deep learning or would be feasible to integrate in a data-driven approach.

Keywords: Colour | Deep learning | Texture | Visual recognition

Abstract: A vision-based experimental methodology was developed for monitoring the surface state evolution of specimens during twin-disc rolling contact tests, aimed at providing information for identifying the damage phenomena. The system is based on a high-speed camera and three laser pointers for illuminating the specimen surface. Images of the specimen surface are acquired and processed, allowing the definition of synthetic surface state indexes, as well as the section profiles of the surface. The vision system was applied to alternated dry–wet rolling–sliding contact tests on railway wheel steel specimens, highlighting its effectiveness in the damage evaluation. The potential of the section profile reconstruction as a tool for surface topology analysis was shown.

Keywords: damage assessment | image processing | Online monitoring | rolling contact fatigue | wear

Abstract: Color schemes play a crucial role in blending virtual objects with the real environment. Good color schemes improve user’s perception, which is of crucial importance for augmented reality. In this paper, we propose a set of novel methods based on the color harmonization methodology to recolor augmented reality content according to the real background. Three different strategies are proposed—harmonic, disharmonic, and balance—that allow for satisfying different needs in different settings depending on the application field. The first approach aims to harmonize the colors of virtual objects to make them consistent with the colors of the real background and reach a more pleasing effect to a human eye. The second approach, instead, can be adopted to generate a set of disharmonious colors with respect to real ones to be associated with the augmented virtual content to improve its distinctiveness from the real background. The third approach balances these goals by achieving a compromise between harmony and good visibility among virtual and real objects. Furthermore, the proposed re-coloring method is applied to three different case studies by adopting the three strategies to meet three different objectives, which are specific for each case study. Several parameters are calculated for each test, such as the covered area, the color distribution, and the set of generated colors. Results confirm the great potential of the proposed approaches to improve the AR visualization in different scenarios.

Keywords: Augmented reality | Color harmonization | Image processing

Abstract: This paper introduces a low-cost and low computational marker-less motion capture system based on the acquisition of frame images through standard RGB cameras. It exploits the open-source deep learning model CMU, from the tf-pose-estimation project. Its numerical accuracy and its usefulness for ergonomic assessment are evaluated by a proper experiment, designed and per-formed to: (1) compare the data provided by it with those collected from a motion capture golden standard system; (2) compare the RULA scores obtained with data provided by it with those obtained with data provided by the Vicon Nexus system and those estimated through video analysis, by a team of three expert ergonomists. Tests have been conducted in standardized laboratory conditions and involved a total of six subjects. Results suggest that the proposed system can predict angles with good consistency and give evidence about the tool’s usefulness for ergonomist.

Keywords: Ergonomic risk assessment | Industrial ergonomics | Motion capture | Postural analysis | RULA

Abstract: Driver behaviour recognition is of paramount importance for in-car automation assistance. It is widely recognized that not only attentional states, but also emotional ones have an impact on the safety of the driving behaviour. This research work proposes an emotion-aware in-car architecture where it is possible to adapt driver’s emotions to the vehicle dynamics, investigating the correlations between negative emotional states and driving performances, and suggesting a system to regulate the driver’s engagement through a unique user experience (e.g. using music, LED lighting) in the car cabin. The relationship between altered emotional states induced through auditory stimuli and vehicle dynamics is investigated in a driving simulator. The results confirm the need for both types of information to improve the robustness of the driver state recognition function and open up the possibility that auditory stimuli can modify driving performance somehow.

Keywords: Driver monitoring system | Emotion recognition | Facial expression recognition

Abstract: This paper introduces a new recommendation system for museums able to profile the visitors and propose them the most suitable exhibition path accordingly, to improve visitors’ satisfaction. It consists of an interactive touch screen totem, which implements a USB camera and exploits Convolutional Neural Network to perform facial coding to measure visitors’ emotions and estimate their age and gender. Based on the detected level of emotional valence, the system associates visitors with a profile and suggests them to visit a selection of five works of art, following a specific itinerary. An extensive experimentation lasting 2 months has been carried out at the Modern Art Museum “Palazzo Buonaccorsi” of Macerata. Results evidence that the proposed system can create an interactive and emotional link with the visitors, influencing their mood in the Pre-Experience phase and in the subsequent Post-Experience phase. In particular, they highlight that the proposed system, which aims at acting as emotional leverage, has been able to improve the positiveness of the emotions experienced by the visitors.

Keywords: Affective computing | Cultural heritage | Emotion recognition | Facial expression recognition

Abstract: Vibration measurements of turbomachinery components are of utmost importance to char-acterize the dynamic behavior of rotating machines, thus preventing undesired operating conditions. Local techniques such as strain gauges or laser Doppler vibrometers are usually adopted to collect vibration data. However, these approaches provide single-point and generally 1D measurements. The present work proposes an optical technique, which uses two low-speed cameras, a multimedia projector, and three-dimensional digital image correlation (3D-DIC) to provide full-field measurements of a bladed disk undergoing harmonic response analysis (i.e., pure sinusoidal excitation) in the kHz range. The proposed approach exploits a downsampling strategy to overcome the limitations introduced by low-speed cameras. The developed experimental setup was used to measure the response of a bladed disk subjected to an excitation frequency above 6 kHz, providing a deep insight in the deformed shapes, in terms of amplitude and phase distributions, which could not be feasible with single-point sensors. Results demonstrated the system’s effectiveness in measuring amplitudes of few microns, also evidencing blade mistuning effects. A deeper insight into the deformed shape analysis was provided by considering the phase maps on the entire blisk geometry, and phase variation lines were observed on the blades for high excitation frequency.

Keywords: Bladed disk vibration | Digital image correlation | Downsampling | Low-speed cameras | Mistuning

Abstract: Motion capture (Mocap) systems are considered more and more interesting for the assessment of rehabilitation processes. In fact, medical personnel are increasingly demanding for technologies (possibly low-cost) to quantitatively measure and assess patients’ improvements during rehabilitation exercises. In this paper, we focus the attention on the assessment of rehabilitation process for injured shoulders. This is particularly challenging because the recognition and the measurement of compensatory movements are very difficult during visual assessment and the movements of a shoulder are complex and arduous to be captured. The proposed solution integrates a low-cost Mocap system with video processing techniques to allow a quantitative evaluation of abduction, which is one of the first post-surgery exercises required for shoulder rehabilitation. The procedure is based on a set of open-source software tools to measure abduction and evaluate the correctness of the movement by detecting and measuring compensatory movements according to the parameters commonly considered by the physicians. Finally, a preliminary results and future works are presented and discussed.

Keywords: Embedded Knowledge | Medical assessment | Microsoft Kinect v2 | Motion Capture | Post-surgery shoulder

Abstract: Dynamic characterization of vibrating targets represents a critical issue for many industrial fields. In this paper, a stereo-camera system integrated with a Digital Image Correlation (DIC) algorithm is proposed with the aim at performing 3D full-field vibration measurements in the range of kHz. The system exploits two industrial low-speed cameras, and the Nyquist-Shannon frequency limitation is overcome by a down-sampling approach under the hypothesis that the vibration signal is characterized by a single known frequency component. Experimental results obtained from the measurement of vibrational responses of a cantilever plate excited at three high-frequency resonance values (1121 Hz, 2956 Hz and 4010 Hz) are provided. A comparison with numerical analyses evidences the effectiveness of the proposed approach.

Keywords: Digital Image Correlation | Low-frame-rate cameras | Stereo-camera setup | Vibration measurement

Abstract: In recent decades, increasing attention is being paid to the multidisciplinary approach that allows the performance of both a preventive conservation and a more invasive restoration action. In this context, the present study aims to acquire information and data from field surveys undertaken in San Domenico Church, Southern Calabria, in order to provide a tool for the recording and the inventory of damage and decay phenomena, and assess their causes and scale. The subsequent calculation of damage indices also provided useful information in order to allow the prioritization of conservation and preservation responses.

Keywords: Built heritage | Calabria | Computer graphics | Damage diagnosis | Decay | Italy | Photogrammetry

Abstract: Histological evaluation plays a major role in cancer diagnosis and treatment. The appearance of H&E-stained images can vary significantly as a consequence of differences in several factors, such as reagents, staining conditions, preparation procedure and image acquisition system. Such potential sources of noise can all have negative effects on computer-assisted classification. To minimize such artefacts and their potentially negative effects several color pre-processing methods have been proposed in the literature—for instance, color augmentation, color constancy, color deconvolution and color transfer. Still, little work has been done to investigate the efficacy of these methods on a quantitative basis. In this paper, we evaluated the effects of color constancy, deconvolution and transfer on automated classification of H&E-stained images representing different types of cancers—specifically breast, prostate, colorectal cancer and malignant lymphoma. Our results indicate that in most cases color pre-processing does not improve the classification accuracy, especially when coupled with color-based image descriptors. Some pre-processing methods, however, can be beneficial when used with some texture-based methods like Gabor filters and Local Binary Patterns.

Keywords: Color | H&E staining | Histology images | Texture

Abstract: In this paper, we investigate the role of shape and texture features from 18F-FDG PET/CT to discriminate between benign and malignant solitary pulmonary nodules. To this end, we retrospectively evaluated cross-sectional data from 111 patients (64 males, 47 females, age = 67.5 ± 11.0) all with histologically confirmed benign (n = 39) or malignant (n = 72) solitary pulmonary nodules. Eighteen three-dimensional imaging features, including conventional, texture, and shape features from PET and CT were tested for significant differences (Wilcoxon-Mann-Withney) between the benign and malignant groups. Prediction models based on different feature sets and three classification strategies (Classification Tree, k-Nearest Neighbours, and Naïve Bayes) were also evaluated to assess the potential benefit of shape and texture features compared with conventional imaging features alone. Eight features from CT and 15 from PET were significantly different between the benign and malignant groups. Adding shape and texture features increased the performance of both the CT-based and PET-based prediction models with overall accuracy gain being 3.4–11.2 pp and 2.2–10.2 pp, respectively. In conclusion, we found that shape and texture features from 18F-FDG PET/CT can lead to a better discrimination between benign and malignant lung nodules by increasing the accuracy of the prediction models by an appreciable margin.

Keywords: Radiomics | Shape | Solitary pulmonary nodule | Texture

Abstract: There is increasing evidence that shape and texture descriptors from imaging data could be used as image biomarkers for computer-assisted diagnosis and prognostication in a number of clinical conditions. It is believed that such quantitative features may help uncover patterns that would otherwise go unnoticed to the human eye, this way offering significant advantages against traditional visual interpretation. The objective of this paper is to provide an overview of the steps involved in the process – from image acquisition to feature extraction and classification. A significant part of the work deals with the description of the most common texture and shape features used in the literature; overall issues, perspectives and directions for future research are also discussed.

Keywords: Computer-assisted medicine | Radiomics | Shape | Texture

Abstract: Cellular materials have a bulk matrix with a larger number of voids named also cells. Metallic foams made by powder technology represent stochastic closed cells. The related inhomogeneity leads to a scattering of results both in terms of stress-strain curves and maximum strength. Scattering is attributed to relative density variations and local cell discontinuities and it is confirmed also in case of dynamic loading. Finite element simulations through geometrical models that are able to capture the void morphology (named “mesoscale models”), confirm these results and some efforts have been already done to quantify the relationship between shape irregularities and mechanical behavior. The aim of this paper is to present the dynamic characterization of an AA7075 closed cell material and to calibrate its mesoscale finite element model according to the related cell shape distribution. Specimens have been derived from a small ingot (45x45x100 mm) divided along sections so that morphological analysis and experimental tests have been carried out. Specimens extracted from a half of the ingot have been used for dynamic compression tests by means of a split Hopkinson bar, meanwhile specimens extracted from the other half of the ingot have been dissected for porosity distribution analyses carried out by means of image analysis. Stress-strain curves obtained from the mechanical tests have been discussed in terms of strain rate and statistical descriptors of the porosity. Successively a 3D-model of the specimen has been generated starting from the Voronoi algorithm, assigning as input the above-mentioned statistical distribution of the porosity. Due to the peculiarity of the cell morphology (e.g. single larger cells), stress-strain localization has been demonstrated as one of the reasons of the scattering found during the experiments. A material model, to reproduce the investigated foam mechanical behavior, has been calibrated. Despite the difference among experiments the material model is able to reproduce all of them. Difference between the model coefficients quantifies roughly the difference due to the local geometry of the cells.

Keywords: Aluminum foams | Image analysis | Impact test | Porosity distribution | Strain rate effect | Voronoi model

Abstract: The introduction of the vacuum bell (VB) for the conservative treatment of Pectus Excavatum (PE) has led to a new non-invasive alternative to thoracic surgery. The VB works by elevating the chest as long as a negative differential pressure is internally assured. In recent years studies have been conducted to validate this type of treatment and to outline its correct use; results show a short-term PE improvement when the device is worn for a minimum of 30 min (twice a day) up to a maximum of several hours a day for 12–15 months. Although the worldwide diffusion of VB devices increases year after year, its ability to lift the chest during treatment with respect to the applied pressure has begun to be evaluated only recently. In this paper, a new instrument for measuring chest elevation during treatment is presented and validated. The proposed system consists of two measurement devices: a commercial instrument for the detection of the negative pressure inside the VB, and a specifically developed optical system for the detection of chest movement. The effectiveness of the proposed system, tested on five paediatric patients, paves the way to the objective definition of an optimised patient specific VB scheme of use.

Keywords: Image processing | Optical measurement | Pectus Excavatum | Vacuum bell

Abstract: Additive Manufacturing is becoming a suitable production process for many industries: it is based on the idea of adding material layer by layer, in opposite to traditional manufacturing processes. This technology shows advantages as design flexibility, internal logistics minimization and product customization that make it perfect to produce customized parts and all the applications where low production rates occur. The production of spare parts for classic or luxury cars is a field where Additive Manufacturing can be adopted because of low demand and relevant costs to manage stocks keeping several different parts in the after-sales inventory. The photogrammetry technique has been investigated to obtain the 3D model of the component to be replaced and send it to decentralized production centers equipped with 3D printers. This approach can enhance by far the supply chain management for automotive spare parts.

Keywords: Additive Manufacturing | Automotive | Maintenance | Photogrammetry | Supply chain management

Abstract: Nowadays, the development of Internet of Things (IoT) technologies have been enhancing the factory digitalization with several advantages in terms of production efficiency, product quality, and cost reduction. This opportunity encourages the implementation of digital twins related to physical systems for controlling the production workflow in real time. Firstly, the paper studies the enabling technologies for supporting the defect analysis in the context of Industry 4.0 for mechanical workpieces. Secondly, the approach aims to study the integration between the CAD geometry and the quality check process for the inspection planning. A Knowledge-Based tool has been proposed to support the configurations of the quality control chain for each CAD geometry. The test case is focused on the fragmented production of customized gearbox parts.

Keywords: Gearbox | Industry 4.0 | Knowledge Base | Machine Vision | Quality Control

Abstract: In the field of Engineering, research has conveniently exploited the fluids for energy production. The possibility to use marine renewable energy is still under development, in particular, among the wave energy converter devices the U-OWC systems are the most promising. The main objective of this work is to validate a numerical model with an experimental campaign that aims to simulate the flow field in front of the breakwater and inside the U-OWC. The tests were carried out to understand the hydrodynamic behaviour of the device in regular wave conditions, inside a flume with rectangular section, equipped by a piston-type wave-maker and a U-OWC device, reproducing the REWEC caisson installed in the Natural Ocean Engineering Laboratory (NOEL) of Reggio Calabria, with a 1:13.5 scale. Measurements of the water free surface were used exclusively to validate the 2D numerical model developed through the Ansys Fluent Computational Fluid-Dynamics (CFD) Software. The numerical model solves the fluid flow field using the RANS equations, in which the air-water interaction governed by this set of partial difference equations is solved with the Finite Volume Method (FVM). In conclusion, results related to the energy efficiency of the caisson were extrapolated from the validated numerical model.

Keywords: Computational fluid dynamics | Image analysis | U-OWC | Wave energy

Abstract: The most common clinical treatment for ear deformities or non-congenital abnormalities is the reconstruction of the missing geometry using autologous costal cartilage. The surgical procedure consists in cutting, sculpting and suturing harvested costal cartilage from the patient to recreate an ear shape which is symmetric to the contralateral ear. During chirurgical operation, surgeons needs an accurate 3D template as reference to reproduce the ear. For this purpose, reverse engineering and additive manufacturing techniques can be employed. Specifically, this works aims to develop a reliable, low-cost and user-friendly system, to acquire the healthy ear geometry in clinical environment avoiding head patient’s exposition to radiation (MRI, CT scan). An ideal acquisition setup and device have been selected to achieve accurate results. To this end, a casted model of an ear was created as reference, and the best setup was evaluated by comparing the obtained 3D reconstructions with it. Once the setup has been determined, the anatomies of five volunteers were acquired, to test the methodology on human subjects.

Keywords: 3D model | Ear | Microtia | Photogrammetry | RealSense D415

Abstract: The paper describes the conceptual model of an emotion-aware car interface able to: map both the driver’s cognitive and emotional states with the vehicle dynamics; adapt the level of automation or support the decision-making process if emotions negatively affecting the driving performance are detected; ensure emotion regulation and provide a unique user experience creating a more engaging atmosphere (e.g. music, LED lighting) in the car cabin. To enable emotion detection, it implements a low-cost emotion recognition able to recognize Ekman’s universal emotions by analyzing the driver’s facial expression from stream video. A preliminary test was conducted in order to determine the effectiveness of the proposed emotion recognition system in a driving context. Results evidenced that the proposed system is capable to correctly qualify the drivers’ emotion in a driving simulation context.

Keywords: Driver Monitoring System | Emotion recognition | Facial expression recognition

Abstract: Advanced Driver-Assistance Systems (ADASs) are used for increasing safety in the automotive domain, yet current ADASs notably operate without taking into account drivers’ states, e.g., whether she/he is emotionally apt to drive. In this paper, we first review the state-of-the-art of emotional and cognitive analysis for ADAS: We consider psychological models, the sensors needed for capturing physiological signals, and the typical algorithms used for human emotion classification. Our investigation highlights a lack of advanced Driver Monitoring Systems (DMSs) for ADASs, which could increase driving quality and security for both drivers and passengers. We then provide our view on a novel perception architecture for driver monitoring, built around the concept of Driver Complex State (DCS). DCS relies on multiple non-obtrusive sensors and Artificial Intelligence (AI) for uncovering the driver state and uses it to implement innovative Human-Machine Interface (HMI) functionalities. This concept will be implemented and validated in the recently EU-funded NextPerception project, which is briefly introduced.

Keywords: Advanced Driver-Assistance System (ADAS) | Artificial Intelligence (AI) | Driver Complex State (DCS) | Driver safety and comfort | Emotion recognition

Abstract: This paper introduces a motion analysis system based on a network of common RGB cameras, which provides the measurement of various angles considered for postural assessment, in order to facilitate the evaluation of the ergonomic indices commonly used for the determination of risk of musculoskeletal disorders of operators in manufacturing workplaces. To enable the tracking of operator postures during the performed tasks, the system exploits the multi person keypoints detection library “OpenPose”. The proposed system has been validated with a real industrial case study regarding a washing machine assembly line. Results suggest how the proposed system supports ergonomists in risk assessment of musculoskeletal disorders through the OCRA index.

Keywords: Assembly line | Ergonomic assessment | Manufacturing | Motion capture | OCRA index | Posture analysis

Abstract: Vitiligo vulgaris is an autoimmune disease which causes a strong reduction of the cells producing melanin, which is the main skin pigment. This results in the growth of white patches on patients' skin, which are more or less visible, depending on the skin phototype. Precise, objective and fast detection of vitiligo patches would be crucial to produce statistically relevant data on huge populations, thus giving an insight on the disease. However, few methods are available in literature. In the present paper, a semi-automatic tool based on image processing to detect facial vitiligo patches is described. The tool requires pictures to be captured under black light illumination, which enhances patches contrast with respect to healthy skin. The user is only required to roughly define the regions of interest and set a global threshold, thus, no specific image-processing skills are required. An adaptive algorithm then automatically discerns between vitiligo and healthy skin pixels. The tools also allow for a statistical data interpretation by overlapping the detected patches of all patients on a face template through an occurrence map. Preliminary results obtained on a small population of 15 patients allowed us to assess the tool's performance. Patch detection was checked by an experienced dermatologist, who confirmed the detection for all the studied patients, thus supporting the effectiveness of the proposed tool.

Keywords: Black light | Image processing | Semi-automatic vitiligo detection | Vitiligo

Abstract: The current research reports for the first time the use of blends of poly(ε-caprolactone) (PCL) and poly(ester amide) (PEA) for the fabrication of 3D additive manufactured scaffolds. Tailor made PEA was synthesized to afford fully miscible blends of PCL and PEA using different percentages (5, 10, 15 and 20% w/w). Stability, characteristic temperatures and material's compatibility were studied through thermal analyses (i.e., TGA, DSC). Even though DMTA and static compression tests demonstrated the possibility to improve the storage modulus, Young's modulus and maximum stress by increasing the amount of PEA, a decrease of hardness was found beyond a threshold concentration of PEA as the lowest values were achieved for PCL/PEA (20% w/w) scaffolds (from 0.39 ± 0.03 GPa to 0.21 ± 0.02 GPa in the analysed load range). The scaffolds presented a controlled morphology and a fully interconnected network of internal channels. The water contact angle measurements showed a clear increase of hydrophilicity resulting from the addition of PEA. This result was further corroborated with the improved adhesion and proliferation of human mesenchymal stem cells (hMSCs). The presence of PEA also influenced the cell morphology. Better cell spreading and a much higher and homogenous number of cells were observed for PCL/PEA scaffolds when compared to PCL ones.

Keywords: Additive manufacturing | Biological properties | Image analysis | Poly(ester amide) | Scaffold design | Thermal and mechanical properties

Abstract: The control of the process–structure–property relationship of a material plays an important role in the design of biomedical metal devices featuring desired properties. In the field of endodontics, several post-core systems have been considered, which include a wide range of industrially developed posts. Endodontists generally use posts characterized by different materials, sizes, and shapes. Computer-aided design (CAD) and finite element (FE) analysis were taken into account to provide further insight into the effect of the material–shape combination of metal posts on the mechanical behavior of endodontically treated anterior teeth. In particular, theoretical designs of metal posts with two different shapes (conical-tapered and conical-cylindrical) and consisting of materials with Young’s moduli of 110 GPa and 200 GPa were proposed. A load of 100 N was applied on the palatal surface of the crown at 45◦ to the longitudinal axis of the tooth. Linear static analyses were performed with a non-failure condition. The results suggested the possibility to tailor the stress distribution along the metal posts and at the interface between the post and the surrounding structures, benefiting from an appropriate combination of a CAD-based approach and material selection. The obtained results could help to design metal posts that minimize stress concentrations.

Keywords: Computer-aided design (CAD) | Dental materials | Finite element analysis | Image analysis | Mechanical properties | Metal posts

Abstract: This paper deals with parenthood perception (maternal and paternal) after the visualization and interaction (touch) with a 3D printed facial fetal model. The model is created using Additive Manufacturing techniques, starting from the image elaboration of routine ultrasound data. In this study, the method used for the elaboration and construction of 3D printable models of fetal faces starting from routine ultrasound images is briefly described. In addition, we present the results of a new survey conducted with future parents at the Altamedica clinic (Rome, Italy) to verify whether there are any benefits derived from the use of 3D printing models with future parents, both regarding the improvement of the parenthood experience, and the improvement of the understanding and collaboration with the physicians in case of fetal malformations, using 3D models coupled with the data of routine ultrasound examinations.

Keywords: 3D ultrasound | Additive manufacturing | Fetal face | Image processing | Parenthood perception | Survey

Abstract: Introduction and Objectives Fabrication processes for spinal orthoses require accurate three-dimensional (3D) models of the patients' trunk. Current methods for 3D reconstruction used in this field mainly include laser or structured light scanning; these methods are time expensive and invasive, especially for patients with partial disabilities. Therefore, a theoretically instant system for data acquisition of anatomical structure is highly desirable. The objective of this work is to show the feasibility of using digital photogrammetry for human body digitization to generate accurate 3D models of the patients' trunk for spinal orthoses fabrication. Materials and Methods Multiple synchronized two-dimensional images of the human torso are captured from different points of view using a photogrammetric scanner. A 3D model is generated using the state-of-the-art algorithms for point cloud and surface reconstruction. The digitized model is then used as input for the standard computer-aided design (CAD)/computer-aided manufacturing (CAM) process of fabrication. R4D from Rodin4D is used as prosthetics and orthotics CAD software. A robotic cell constituted by a six-axis KUKA KR 30-3 is used for milling a polyurethane foam. Vacuum forming is then adopted to generate the orthosis. Two spinal orthoses are fabricated using this approach and a classical one; then, they are evaluated using quantitative and qualitative metrics. Results The data acquisition using this approach lasts 50 milliseconds. The 3D reconstruction accuracy averages 0.21 ± 1.27 mm, which suits for the considered health care scenario. Results of the initial fitting of the orthoses fabricated with the presented method show better performances in terms of time (44%), product quality (35%), and patient experience (30%). Conclusions Digital photogrammetry can be used to enhance the data acquisition and data processing of anatomical surfaces for the CAD/CAM process of spinal orthoses. The data acquisition time, almost instant, allows an easy compliance of many patients. The data processing allows generating accurate models of the patient's body. The overall process generates orthoses with a better quality with respect to those manufactured using conventional procedures. ©

Keywords: CAD/CAM | fabrication techniques | photogrammetry | prosthetics and orthotics | spinal orthoses | three-dimensional reconstruction

Abstract: A single-camera stereo-digital image correlation (stereo-DIC) system to obtain 3D full-field vibration measurements is proposed. The optical setup is composed of two planar mirrors and a single low frame rate camera, thus resulting in a compact and low-cost equipment. The two mirrors are used to create pseudo-stereo images of a target surface on the camera sensor, which are then correlated by using stereo-DIC. The image acquisition process is carried out at low frame rates and the Nyquist-Shannon frequency limitation is overcome by adopting a down-sampling approach under the hypothesis that the vibration signal is characterized by a single known frequency component. The developed pseudo-stereo DIC system allows to obtain 3D full-field vibration measurements in a frequency range up to 4 kHz even with an available frame rate (at full resolution) of 178 fps. The effectiveness of the described approach has been verified by performing vibration measurements on a cantilever plate and a turbine blade.

Keywords: Digital image correlation | Down-sampling approach | Single low-speed camera | Vibration measurement

Abstract: The concept of "surface modeling" generally describes the process of representing a physical or artificial surface by a geometric model, namely a mathematical expression. Among the existing techniques applied for the characterization of a surface, terrain modeling relates to the representation of the natural surface of the Earth. Cartographic terrain or relief models as threedimensional representations of a part of the Earth's surface convey an immediate and direct impression of a landscape and are much easier to understand than two-dimensional models. This paper addresses a major problem in complex surface modeling and evaluation consisting in the characterization of their topography and comparison among different textures, which can be relevant in different areas of research. A new algorithm is presented that allows calculating the fractal dimension of images of complex surfaces. The method is used to characterize different surfaces and compare their characteristics. The proposed new mathematical method computes the fractal dimension of the 3D space with the average space component of Hurst exponent H, while the estimated fractal dimension is used to evaluate, compare and characterize complex surfaces that are relevant in different areas of research. Various surfaces with both methods were analyzed and the results were compared. The study confirms that with known coordinates of a surface, it is possible to describe its complex structure. The estimated fractal dimension is proved to be an ideal tool for measuring the complexity of the various surfaces considered.

Keywords: Fractal dimension | Hurst exponent H | Image analysis | Space component | Surface

Abstract: This paper compares the effects of colour pre-processing on the classification performance of H&E-stained images. Variations in the tissue preparation procedures, acquisition systems, stain conditions and reagents are all source of artifacts that can affect negatively computer-based classification. Pre-processing methods such as colour constancy, transfer and deconvolution have been proposed to compensate the artifacts. In this paper we compare quantitatively the combined effect of six colour pre-processing procedures and 12 colour texture descriptors on patch-based classification of H&E-stained images. We found that colour pre-processing had negative effects on accuracy in most cases – particularly when used with colour descriptors. However, some pre-processing procedures proved beneficial when employed in conjunction with classic texture descriptors such as co-occurrence matrices, Gabor filters and Local Binary Patterns.

Keywords: Colour | Eosin | Hematoxylin | Histology | Texture

Abstract: In this paper we investigate extensions of Local Binary Patterns (LBP), Improved Local Binary Patterns (ILBP) and Extended Local Binary Patterns (ELBP) to colour textures via two different strategies: intra-/inter-channel features and colour orderings. We experimentally evaluate the proposed methods over 15 datasets of general and biomedical colour textures. Intra- and inter-channel features from the RGB space emerged as the best descriptors and we found that the best accuracy was achieved by combining multi-resolution intra-channel features with single-resolution inter-channel features.

Keywords: Colour | Local binary patterns | Texture

Abstract: The preservation status of an underwater cultural site can be determined as the combination of two primary factors, namely the site physical integrity, which results from the past and present interaction of the site itself with the biological/chemical agents located in the surrounding environment, and the exposure of the site to human-related threats. Methods to survey underwater archaeological sites have evolved considerably in the last years in order to face the challenges and problems in archaeological prospection, documentation, monitoring, and data collection.This paper presents a case-study of an archaeological documentation campaign addressed to study and monitor the preservation status of an underwater archaeological site by combining the quantitative measurements coming from optical and acoustic surveys with the study of biological colonization and bioerosion phenomena affecting ancient artefacts. In particular, we present the first results obtained in the survey and documentation campaign carried out during the spring - summer 2018 in the "Nymphaeum of Punta Epitaffio" located in the Marine Protected Area - Underwater Park of Baiae (Naples).

Keywords: 3D Imaging | 3D Mapping | Baiae Archaeological Park | Photogrammetry | Underwater Archaeology

Abstract: Structural S355 steel is widely applied in various sectors. Fatigue properties are of fundamental importance and extremely time consuming to be assessed. The aim of this research activity is to apply the Static Thermographic Method during tensile tests and correlate the temperature trend to the fatigue properties of the same steel. The Digital Image Correlation (DIC) and Infrared Thermography (IR) techniques have been used during all static tests. The Digital Image Correlation technique allowed the detection of displacements and strain, and so the evaluation of the mechanical properties of the material. Traditional fatigue tests were also performed in order to evaluate the stress-number of cycles to failure curve of the same steel. The value of the fatigue limit, obtained by the traditional procedure, was compared with the values predicted by means of the Static Thermographic Method (STM) obtained from tensile tests. The predicted values are in good agreement with the experimental values of fatigue life.

Keywords: Digital image correlation | Fatigue | Infrared thermography | Marine structures | Tensile tests

Abstract: In the fashion field, the use of electroplated small metal parts such as studs, clips and buckles is widespread. The plate is often made of precious metal, such as gold or platinum. Due to the high cost of these materials, it is strategically relevant and of primary importance for manufacturers to avoid any waste by depositing only the strictly necessary amount of material. To this aim, companies need to be aware of the overall number of items to be electroplated so that it is possible to properly set the parameters driving the galvanic process. Accordingly, the present paper describes a simple, yet effective machine vision-based method able to automatically count small metal parts arranged on a galvanic frame. The devised method, which relies on the definition of a rear projection-based acquisition system and on the development of image processing-based routines, is able to properly count the number of items on the galvanic frame. The system is implemented on a counting machine, which is meant to be adopted in the galvanic industrial practice to properly define a suitable set or working parameters (such as the current, voltage, and deposition time) for the electroplating machine and, thereby, assure the desired plate thickness from one side and avoid material waste on the other.

Keywords: Electro-deposition industry | Image analysis | Item counting device | Machine vision

Abstract: This paper presents a software based on an innovative Convolutional Neural Network model to recognize the six Ekman's universal emotions from the photos of human faces captured in the wild. The CNN was trained using three different datasets already labeled and merged after making them homogeneous. A comparison among different types of CNN architectures using the Keras framework for Python language is proposed and the evaluation results are presented.

Keywords: convolutional neural network | deep learning | emotion recognition

Abstract: The study of human factors is fundamental for the human-centered design of Smart Workplaces. IIoT (Industrial Internet of Things) technologies, mainly wearable devices, are becoming necessary to acquire data, whose analysis will be used to make decision in a smart way. For industrial applications, motion-tracking systems are strongly developing, being not invasive and able to acquire high amounts of data related to human motion in order to evaluate the ergonomic indexes in an objective way, as well as suggested by standards. For these reasons, a modular inertial motion capture system has been developed at the Department of Engineering of the University of Campania Luigi Vanvitelli. By using low cost Inertial Measurement Units – IMU and sensor fusion algorithms based on Extended Kalman filtering, the system is able to estimate the orientation of each body segment, the posture angles trends and the gait recognition during a working activity in industrial environment. From acquired data it is possible to develop further algorithms to online asses ergonomic indexes according to methods suggested by international standards (i.e. EAWS, OCRA, OWAS). In this paper, the overall ergonomic assessment tool is presented, with an extensive result campaign in automotive assembly lines of Fiat Chrysler Automobiles to prove the effectiveness of the system in an industrial scenario.

Keywords: IMU | Industrial environment | Industrial ergonomics | Motion capture | Wearable device

Abstract: Nowadays, facial mimicry studies have acquired a great importance in the clinical domain and 3D motion capture systems are becoming valid tools for analysing facial muscles movements, thanks to the remarkable developments achieved in the 1990s. However, the face analysis domain suffers from a lack of valid motion capture protocol, due to the complexity of the human face. Indeed, a framework for defining the optimal marker set layout does not exist yet and, up to date, researchers still use their traditional facial point sets with manually allocated markers. Therefore, the study proposes an automatic approach to compute a minimum optimized marker layout to be exploited in facial motion capture, able to simplify the marker allocation without decreasing the significance level. Specifically, the algorithm identifies the optimal facial marker layouts selecting the subsets of linear distances among markers that allow to automatically recognizing with the highest performances, through a k-nearest neighbours classification technique, the acted facial movements. The marker layouts are extracted from them. Various validation and testing phases have demonstrated the accuracy, robustness and usefulness of the custom approach.

Keywords: 3D face | Face analysis | Feature extraction | Marker optimization | Motion capture

Abstract: This paper describes the conceptual model and the implementation of an emotion aware system able to manage multimedia contents (i.e., music tracks) and lightning scenarios, based on the user’s emotion, detected from facial expressions. The system captures the emotions from the user’s face expressions, mapping them into a 2D valence-arousal space where the multimedia content is mapped and matches them with lighting color. A preliminary experimentation involved a total of 26 subjects has been carried out with the purpose of assess the system emotion recognition effectiveness and its ability to manage the environment appropriately. Results evidenced several limits of emotion recognition through face expressions detection and opens to several research challenges.

Keywords: Affective computing | Ambient intelligence | Emotion detection | Emotion recognition | Emotion-aware system | Face expression recognition | Smart environment

Abstract: Aboveground biomass (AGB) is a parameter commonly used for assessing and monitoring primary productivity of grassland communities. Destructive AGB measurements, although accurate, are time-consuming and do not allow for repeated measurements as required by monitoring protocols. Structure-from-motion (SfM) photogrammetry has been proved to be a reliable tool for rapid and not destructive AGB estimations in grass systems. Three-dimensional (3D) models of fourteen 1 × 1 m2 pasture plots were reconstructed and AGB volume measured under several measurement settings. Volume-based AGB measures were regressed to AGB values resulting from destructive methods to identify the measurement settings that show the best fit. Furthermore, 3D models of four mountain pasture plots were reconstructed in May, July, and August. Models relative to the same plot were aligned and their relative difference measured to produce a diachronic canopy variation model (DCVM). On the measured volume (Vd), the coefficient of density (cρ) was applied to adjust the volume values (Vadj) in relation to variation due to different DCVM point densities. The measurement setting for AGB volume estimations strongly influenced their correlation with traditional AGB scores. The best fit was obtained selecting 1 mm grid cell size and minimum point height distance. Such options were then selected to measure the DCVM. Adjusted volumes were fully correlated with the average point distance. Three plots revealed higher rates of AGB in the spring compared to summer season, as justified by the summer aridity constraints affecting vegetation productivity in Mediterranean areas. In one plot, we found an anomalous seasonal pattern, showing an AGB reduction in spring, which can be correlated with grazing, that promoted a subsequent increment in summer. Our study indicates that image-based photogrammetric techniques allow for reliable non-destructive measurements of surface biomass in diachronic analyses, offering a valuable tool for evaluating occurrence, magnitude, and spatial patterns of variations of community primary productivity over time. Diachronic canopy variation model produced congruent patterns of inter-seasonal canopy variations proving to be a useful tool for analyzing local disturbance to vegetation canopy caused by grazing.

Keywords: biomass | coefficient of density | diachronic variation | local disturbance | non-destructive measurements | pasture community | photogrammetry | structure-from-motion

Abstract: In this paper, we present a solution for the photorealistic ambient light render of holograms into dynamic real scenes, in augmented reality applications. Based on Microsoft HoloLens, we achieved this result with an Image Base Lighting (IBL) approach. The real-time image capturing that has been designed is able to automatically locate and position directional lights providing the right illumination to the holograms. We also implemented a negative "shadow drawing" shader that contributes to the final photorealistic and immersive effect of holograms in real life. The main focus of this research was to achieve a superior photorealism through the combination of real-time lights placement and negative "shadow drawing" shader. The solution was evaluated in various Augmented Reality case studies, from classical ones (using Vuforia Toolkit) to innovative applications (using HoloLens).

Keywords: Augmented reality | Holographic shadow | Image processing | Light mapping | Rendering techniques

Abstract: Objectives: To assess conceptual designs of dental posts consisting of polyetherimide (PEI) reinforced with carbon (C) and glass (G) glass fibers in endodontically treated anterior teeth. Methods: 3D tessellated CAD and geometric models of endodontically treated anterior teeth were generated from Micro-CT scan images. Model C-G/PEI composite posts with different Young's moduli were analyzed by Finite Element (FE) methods post A (57.7 GPa), post B (31.6 GPa), post C (from 57.7 to 9.0 GPa in the coronal–apical direction). A load of 50 N was applied at 45° to the longitudinal axis of the tooth, acting on the palatal surface of the crown. The maximum principal stress distribution was determined along the post and at the interface between the post and the surrounding structure. Results: Post C, with Young's modulus decreasing from 57.7 to 9.0 GPa in the coronal–apical direction, reduced the maximum principal stress distribution in the restored tooth. Post C gave reduced stress and the most uniform stress distribution with no stress concentration, compared to the other C-G/PEI composite posts. Significance: The FE analysis confirmed the ability of the functionally graded post to dissipate stress from the coronal to the apical end. Hence actual (physical) C-G/PEI posts could permit optimization of stress distributions in endodontically treated anterior teeth.

Keywords: CAD | Dental materials | Design | Endodontic treatment | Finite Element analysis | Image analysis

Abstract: Over recent years, various virtual prototyping technologies have been developed to innovate apparel industry. For each step of the garment design process one can find dedicated tools (from body acquisition to garment modelling and simulation) with the aim of making the process easier and faster. However, most of them are based on expensive solutions both for hardware and software systems. In this paper, we focus the attention on the first step of the made-to-measure garment design, i.e. customer’s measures acquisition. We present a plug-in, named Tailor Tracking, which permits to get the measurements by interacting with the customer’s avatar using hands as in the traditional way. Tailor Tracking has been developed using low cost devices, such as Microsoft Kinect sensor, Leap motion device and Oculus Rift, and open source libraries, such as Visualisation Toolkit (VTK) and Qt. The proposed approach is based on the use of multiple Kinect v2 to simultaneously acquire both customer’s body and motion. This permits to emulate the customer’s postures required to take the correct measurements. In addition, a virtual measuring tape is made available to replicate the one commonly used by the tailor. A men shirt has been considered as case study and a tailor and 14 people with no skills in garment design and different levels of experience in virtual reality technology have been involved to preliminary test Tailor tracking. Finally, tests as well as results reached so far are presented and discussed. Results have been considered quite good; however, some critical measures have been identified as well as future developments. Anyway, Tailor Tracking can represent an alternative solution to the existing approaches that automatically extract anthropometric measures from the customer’s avatar.

Keywords: Clothing design | garment measurements | hand-tracking device | head mounted display | Kinect sensors | motion capture | virtual reality

Abstract: This paper presents a novel instant 3D whole body scanner for healthcare applications. It is based on photogrammetry, a digital technology which allows to reconstruct the surface of objects starting from multiple pictures. The motivation behind this work is the development of minimally invasive procedures for instant data acquisitions of anatomical structure. The scanner provides several features of interests in 3D body scanning technologies for the healthcare domains: (i) instant capture of human body models; (ii) magnitude of accuracy in the order of 1 mm; (iii) simplicity of use; (iv) possibility to scan using different settings; (v) possibility to reconstruct the texture. The system is built upon a modular and distributed architecture. In this paper we highlight its key concepts and the methodology which has led to the current product. We illustrate its potential through one of the most promising 3D scanning healthcare applications: the data acquisition and processing of human body models for the digital manufacturing process of prostheses and orthoses. We validate the overall system in terms of conformity with the the initial requirements.

Keywords: 3D reconstruction | Body scanning | Healthcare | Human body measurements | Human body visualization | Photogrammetry | Proshetics and orthotics

Abstract: A 3D full-field optical system for high frequency vibration measurement is proposed. The system is composed of a single low-frame-rate camera and two planar mirrors. This compact optical setup overcomes the typical drawback of capturing synchronous acquisitions in the case of a camera pair. Moreover, planar mirrors allow for the use of the classical pinhole model and, thus, conventional stereo-calibration techniques. The use of a low-frame-rate camera provides on the one hand a high-resolution sensor with a relatively low-cost hardware but imposes, on the other, the adoption of a down-sampling approach, which is applicable only when a single (known) sinusoidal load is applied to the structure. The effectiveness of the proposed setup has been verified by the 3D vibration measurement of two different targets up to a frequency of 1 kHz, corresponding to a displacement amplitude of 0.01 mm.

Keywords: digital image correlation | down-sampling approach | Reverse engineering | single low-speed camera

Abstract: Background and objective: The purpose of the present paper is to pave the road to the systematic optimization of complex craniofacial surgical intervention and to validate a design methodology for the virtual surgery and the fabrication of cranium vault custom plates. Recent advances in the field of medical imaging, image processing and additive manufacturing (AM) have led to new insights in several medical applications. The engineered combination of medical actions and 3D processing steps, foster the optimization of the intervention in terms of operative time and number of sessions needed. Complex craniofacial surgical intervention, such as for instance severe hypertelorism accompanied by skull holes, traditionally requires a first surgery to correctly “resize” the patient cranium and a second surgical session to implant a customized 3D printed prosthesis. Between the two surgical interventions, medical imaging needs to be carried out to aid the design the skull plate. Instead, this paper proposes a CAD/AM-based one-in-all design methodology allowing the surgeons to perform, in a single surgical intervention, both skull correction and implantation. Methods: A strategy envisaging a virtual/mock surgery on a CAD/AM model of the patient cranium so as to plan the surgery and to design the final shape of the cranium plaque is proposed. The procedure relies on patient imaging, 3D geometry reconstruction of the defective skull, virtual planning and mock surgery to determine the hypothetical anatomic 3D model and, finally, to skull plate design and 3D printing. Results: The methodology has been tested on a complex case study. Results demonstrate the feasibility of the proposed approach and a consistent reduction of time and overall cost of the surgery, not to mention the huge benefits on the patient that is subjected to a single surgical operation. Conclusions: Despite a number of AM-based methodologies have been proposed for designing cranial implants or to correct orbital hypertelorism, to the best of the authors’ knowledge, the present work is the first to simultaneously treat osteotomy and titanium cranium plaque.

Keywords: Additive manufacturing | CAD | Cranium surgery | Image processing

Abstract: Background/Aim. We retrospectively investigated the prognostic potential (correlation with overall survival) of 9 shape and 21 textural features from non-contrast-enhanced computed tomography (CT) in patients with non-small-cell lung cancer. Materials and Methods. We considered a public dataset of 203 individuals with inoperable, histologically- or cytologically-confirmed NSCLC. Three-dimensional shape and textural features from CT were computed using proprietary code and their prognostic potential evaluated through four different statistical protocols. Results. Volume and grey-level run length matrix (GLRLM) run length non-uniformity were the only two features to pass all four protocols. Both features correlated negatively with overall survival. The results also showed a strong dependence on the evaluation protocol used. Conclusion: Tumour volume and GLRLM run-length non-uniformity from CT were the best predictor of survival in patients with non-small-cell lung cancer. We did not find enough evidence to claim a relationship with survival for the other features.

Keywords: Computed tomography | Non-small-cell lung cancer | Radiomics. | Shape | Texture

Abstract: Convolutional Neural Networks have proved extremely successful in object classification applications; however, their suitability for texture analysis largely remains to be established. We investigate the use of pre-trained CNNs as texture descriptors by tapping the output of the last fully connected layer, an approach that has proved its effectiveness in other domains. Comparison with classical descriptors based on signal processing or statistics over a range of standard databases suggests that CNNs may be more effective where the intra-class variability is large. Conversely, classical approaches may be preferable where classes are well defined and homogeneous.

Keywords: Convolutional Neural Networks | Image classification | Local Binary Patterns | Texture

Abstract: Twin-disk tests are an effective method to characterize the material response to rolling sliding contact, to reproduce the damage phenomena of real components at a laboratory scale in controlled working conditions. Usually the monitoring is performed by means of “gross” parameters, such as weight loss, coefficient of friction and Barkhausen noise, and micrographs of the sample sections, at the end of the test. Visual inspection of the sample contact surface at the macro-scale yields further information about the process under analysis. In twin-disk tests, the samples are visually inspected at predetermined steps, typically by acquiring the image of their surface when the samples are stationary. The availability of a system able to capture the images of the samples while they roll during the tests is of interest to better monitor the damage evolution. In this paper, we present the results of the experiments carried out to extract quantitative information from the images captured on railway wheel samples during rolling contact tests: suitable image processing has been designed with the objective of finding meaningful, synthetic indices for the monitoring and the interpretation of the wear process, also in relation to prior knowledge about the process. The experimental work was focused on the definition of the indices, on the analysis of their behavior on different steels, and on their usefulness to predict uneven wear during the tests on the test bench.

Keywords: Damage monitoring | Image acquisition | Image processing | Twin-disk tests | Wear

Abstract: A vision-based experimental methodology was developed for monitoring the surface state evolution of specimens during bi-disc rolling contact tests, aimed at providing information for identifying the damage phenomena. The system is based on a high-speed camera and three laser pointers for illuminating the specimen surface. Images of the specimen surface are acquired and processed, allowing the definition of synthetic surface state indexes, as well as the 3D reconstruction of the damaged surface topology. The vision system was applied to alternated dry-wet rollingsliding contact tests on railway wheel steel specimens, highlighting its effectiveness in the damage evaluation.

Keywords: Damage assessment. | Image processing | Online monitoring | Rolling contact fatigue | Wear

Abstract: This research aims to develop a system that examines and reacts to the changing behaviors and emotions of individuals in order to improve their shopping experience. The system is able to track emotions in real time at different touchpoints in a store and control a set of networked devices to configure the sensing space and all provided services responsive to the cus-tomers’ needs. This paper describes the general approach adopted to design the overall system and illustrates in detail the module prototyped to understand the users’ emotions through the analysis of facial expressions.

Keywords: Context-aware computing | Emotion recognition | Methods for CX | Shopping experience

Abstract: The visualization and analysis of mosaics and pavements are often compromised by their large sizes, which do not enable the observer to perceive their whole arrangement or to focus on details placed in farthest areas from its boundaries. Moreover, the usual precarious state of conservation of these artefacts, often with damaged or missing areas, makes it difficult to perceive their original aesthetic value. To overcome these limitations, we propose an application of augmented reality able to support the observer in two ways: first, the application completes the missing surface of the mosaic or pavement by integrating the existent surface with a virtual reconstruction; second, it enables the analysis of the geometric pattern of the mosaic/pavement by overlaying virtual lines and geometric figures in order to explicit its geometric arrangements. The result is achieved via a custom Android application able to recognize and track the mosaic figure pattern and extra marker board, obtaining in that way a coordinate system used to render in real-time the reconstruction of the mosaic. Such rendering is overlaid to the video stream of the real scene. The application runs on a standard smartphone embedded in a Google Cardboard-compatible viewer and therefore is extremely affordable. As a case study, in order to reconstruct its aspects and to analyse its geometric pattern, we chose the roman mosaic re-found in Savignano sul Panaro (near Modena, Italy) in 2011, after 115 years from its first discovery, which is preserved less than half of its original 4.5 x 6.9 m surface.

Keywords: Augmented Reality | Cultural heritage | Geometric pattern | Photogrammetry | Real-time visualization | Roman mosaic

Abstract: This paper proposes the integration of photogrammetric reconstruction, 3D modelling and augmented reality application in order to achieve the complete visualization of a stone sculpture even if highly damaged or fragmentary. The first part of the research aims to the reconstruction of the original aspect of an incomplete sculpture, by using photogrammetry techniques based on standard resolution photos and free software in order to obtain a first model; then, we integrate this model with other 3D digital data (from other sculptures of the same period) or with 3D modelling based on historical sources and views from historians, aiming to achieve the original aspect of the sculpture. The second part of the research consists of the embedding of the obtained model in a custom application able to render in real-time the 3D reconstruction of the lion. Then, the rendering is overlaid to the video stream of the real scene and, as a result, a complete 3D digital model of the sculpture is achieved and could be visualized through a VR viewer. As a case study, we focus on a Roman stone sculpture of a male lion conserved in the Museo Estense of Modena (Italy), which lacks of its head and its four legs. The original aspect of the lion may be achieved by integrating the damaged sculpture with other photogrammetric reconstructions of lions sculptures of the same period and with 3D model based on historical sources. Finally, the lion is visualized through an augmented reality application which digitally overlays the reconstructed models on the original one.

Keywords: Augmented Reality | Cultural heritage | Photogrammetry | Real-time visualization | Virtual modeling

Abstract: Meniscectomy significantly change the kinematics of the knee joint by reducing the contact area between femoral condyles and the tibial plateau, but the shift in the contact area has been poorly described. The aim of our investigation was to measure the shift of the tibiofemoral contact area occurring after meniscectomy. We used laser scans combined to surface texturing for measuring the 3D position and area of the femoral and tibial surfaces involved in the joint. In particular, natural condyles (porcine model) were analysed and the reverse engineering approach was used for the interpretation of the results from compression tests and local force measurements in conjunction with staining techniques. The results suggested that laser scans combined to surface texturing may be considered as a powerful tool to investigate the stained contours of the contact area. Beside the largely documented reduction of contact area and local pressure increase, a shift of the centroid of the contact area toward the intercondylar notch was measured after meniscectomy. As a consequence of the contact area shift and pressure increase, cartilage degeneration close to the intercondylar notch may occur.

Keywords: Biomechanics | Centroid | Image analysis | Laser scanning | Surface texturing | Tibiofemoral contact area

Abstract: In the Industry 4.0 and digital revolution era, the world of manufacturing industry is experiencing an innovative reconfiguration of design tools and methodologies, with a different approach to the production processes organization. The design philosophy is changing, integrating to engineering contribution interpretative aspects (design thinking), executive practices (design doing) and cognitive aspects (design cultures). The design becomes human-centered. The new Virtual Reality technologies allow to validate performances of designed products and production processes by means of virtual prototypes in a virtual simulated environment. This approach generates several benefits to the companies, in terms of costs and time, and allows optimizing the assembly line design and related workplaces, by improving workers' benefits too. This paper proposes an innovative method to validate the design of workplaces on automotive assembly lines in a virtual environment, based on ergonomic approach, according to ERGO - Uas system, applied by FCA (Fiat Chrysler Automobiles) groups, that integrates UAS method for measurement and EAWS method for biomechanical effort evaluation. Creating 3D virtual scenarios allows to carry on assembly tasks by virtual manikins in order to be evaluated from different points of view. In particular, data coming from the simulation can be used to assess several ergonomic indexes, improving safety, quality and design. The analysis is supported by the use of a motion capture system, developed by the University of Campania and composed of wearable inertial sensors, that estimates the attitude of fundamental human segments, using sensor fusion algorithms based on Kalman filtering. In this way, it is possible to make a further design validation, assessing the EAWS index basing on posture angles trends evaluated. This method can represent an innovation for human-centered design of workplace in developing new products, reducing costs and improving job quality.

Keywords: design | ergonomics | manufacturing | motion capture | product feasibility | simulation | Virtual reality

Abstract: Objectives To investigate the influence of specific resin-composite, glass ceramic and glass ionomer cement (GIC) material combinations in a “multi-layer” technique to replace enamel and dentin in class II mesio-occlusal-distal (MOD) dental restorations using 3D-Finite Element Analysis (FEA). Methods Four 3D-FE models (A–D) of teeth, adhesively restored with different filling materials, were created and analyzed in comparison with a 3D model (E) of a sound lower molar. Models A, B & C had “multilayer” constructions, consisting of three layers: adhesive, dentin replacement and enamel replacement. Model A: had a low modulus (8 GPa) composite replacing dentin and a higher modulus (12 GPa) composite replacing enamel. Model B: had a GI cement replacing dentin and a higher modulus (12 GPa) composite replacing enamel. Model C: had a low modulus (8 GPa) composite replacing dentin and a very high modulus (70 GPa) inlay replacing enamel. Model D: had a lithium disilicate inlay replacing both dentin and enamel with a luting cement base-layer. Polymerization shrinkage effects were simulated and a load of 600 N was applied. All the materials were assumed to behave elastically throughout the entire deformation. Results Model A showed the highest stress distribution along all the adhesive interfaces of the shrinking resin-based materials with a critical condition and failure risk marginally and internally. Model D, by contrast, showed a more favorable performance than either of the multilayer groups (A–C). Stress and displacement plots showed an elastic response similar to that obtained for the sound tooth model. Model B and Model C performed according to their bilayer material properties. The use of a non-shrink dentin component simulating a GIC clearly affected the shrinkage stress at the basis of the Model B; while the bulk resin composite having a 12 GPa Young's modulus and linear polymerization shrinkage of 1% strongly influenced the biomechanical response in the bucco-lingual direction. Significance Direct resin-based composite materials applied in multilayer techniques to large class II cavities, with or without shrinking dentin layers, produced adverse FEA stress distributions and displacements. An indirect lithium disilicate inlay used to replace lost dentin and enamel in posterior restored teeth generated lower stress levels, within the limits of the elastic FEA model.

Keywords: CAD | Class II restorations | Finite element analysis | Image analysis | Materials properties

Abstract: Objective To assess the effect of a ferrule design with specific post material-shape combinations on the mechanical behavior of post-restored canine teeth. Methods Micro-CT scan images of an intact canine were used to create a 3-D tessellated CAD model, from which the shapes of dentin, pulp and enamel were obtained and geometric models of post-endodontically restored teeth were created. Two types of 15 mm post were evaluated: a quartz fiber post with conical–tapered shape, and a carbon (C) fiber post with conical–cylindrical shape. The abutment was created around the coronal portion of the posts and 0.1 mm cement was added between prepared crown and abutment. Cement was also added between the post and root canal and a 0.25 mm periodontal ligament was modeled around the root. Four models were analysed by Finite Element (FE) Analysis: with/without a ferrule for both types of post material and shape. A load of 50 N was applied at 45° to the longitudinal axis of the tooth, acting on the palatal surface of the crown. The maximum normal stress criterion was adopted as a measure of potential damage. Results Models without a ferrule showed greater stresses (16.3 MPa) than those for models with a ferrule (9.2 MPa). With a ferrule, stress was uniformly distributed along the abutment and the root, with no critical stress concentration. In all models, the highest stresses were in the palatal wall of the root. Models with the C-fiber post had higher stress than models with the quartz fiber posts. The most uniform stress distribution was with the combination of ferrule and quartz fiber post. Significance The FE analysis confirmed a beneficial ferrule effect with the combination of ferrule and quartz fiber post, with tapered shape, affording no critical stress concentrations within the restored system.

Keywords: CAD | Dental materials | Endodontic treatment | Finite element analysis | Image analysis | Materials properties

Abstract: The Italian fashion industry is nowadays subject to radical transformation; therefore, it needs to remain competitive and, at the same time, innovate itself, in order to strengthen its position in the global market. An important opportunity of innovation can be the introduction of ICT technologies in the garment design process, which today is based on traditional methods and tools. Moreover, this innovation could be particularly important for online sales, in order to reduce the customers’ doubts during purchasing. The research presented in this paper describes a framework for designing clothes as realistic 3D digital models and for allowing customers to evaluate the designed clothes by using realistic virtual mannequins of their bodies instead of the standard ones. A case study will be presented in the paper. The obtained results show that the framework can innovate the traditional garment design process and it could have a huge impact on fashion industry and customers behaviours.

Keywords: Body scanning | Cloth simulation | Design process | Motion capture | Virtual prototype

Abstract: Background/purpose: We investigate the use of skin texture features from the inner forearm as a means for personal identification. The forearm offers a number of potential advantages in that it is a fairly accessible area, and, compared with other zones such as fingertips, is less exposed to the elements and more shielded from wear. Methods: We extract and combine skin textural features from two imaging devices (optical and capacitive) with the aim of discriminating between different individuals. Skin texture images from 43 subjects were acquired from three different body parts (back of the hand, forearm and palm); testing used the two sensors either separately or in combination. Results: Skin texture features from the forearm proved effective for discriminating between different individuals with overall recognition accuracy approaching 96%. Conclusions: We found that skin texture features from the forearm are highly individual-specific and therefore suitable for personal identification. Interestingly, forearm skin texture features yielded significantly better accuracy compared to the skin of the back of the hand and of the palm of the same subjects.

Keywords: image processing | personal identification | skin texture | texture analysis

Abstract: Skin appearance is almost universally the object of gender-related expectations and stereotypes. This not with standing, remarkably little work has been done on establishing quantitatively whether skin texture can be used for gender discrimination. We present a detailed analysis of the skin texture of 43 subjects based on two complementary imaging modalities afforded by a visible-light dermoscope and the recently developed Epsilon sensor for capacitive imaging. We consider an array of established texture features in combination with two supervised classification techniques (1-NN and SVM) and a state-of-the-art unsupervised approach (t-SNE). A statistical analysis of the results suggests that skin microtexture carries very little information on gender.

Keywords: Gender recognition | Skin | SVM | Texture

Abstract: A simple and compact Depth-From-Defocus (DFD) setup, using telecentric illumination and liquid-lens based camera observation, was shown to perform well for 3D shape acquisition over extended measuring range. A further step to ameliorate the system performance is described in this paper. We focused on finding an algorithm to speed up the calibration step of the method, that automatically determines the minimum number of focal lengths to be used in the calibration and measurement procedure. As a result, the calibration is significantly shortened (up to 80% with respect to the original procedure), and the need to manually (and to some extent arbitrarily) select the focal length pairs is overcome. Measurement errors down to 0.73 mm over the measurement depth range of 130 mm, corresponding to 0.55% of the depth range are achieved, in total agreement with the original system.

Keywords: Calibration | Depth From Defocus | Image processing | Liquid lenses | Phase modulation | Shape measurement

Abstract: A novel depth from defocus (DFD) measurement system is presented, where the extension of the measurement range is performed using an emergent technology based on liquid lenses. A suitable set of different focal lengths, obtained by properly changing the liquid lens supply voltage, provides multiple camera settings without duplicating the system elements or using moving parts. A simple and compact setup, with a single camera/illuminator coaxial assembly, is obtained. The measurement is based on an active DFD technique using modulation measurement profilometry for the estimation of the contrast at each image point as a function of the depth range. Two different measurement methods are proposed, both based on a combination of multiple contrast curves, each derived at a specific focal length. In the first method (intensity contrast method), the depth information is recovered directly from the contrast curves, whereas in the second (differential contrast method), the depth is measured using contrast curve pairs. We obtained a measurement σ0 of 0.55 mm over a depth range of 60 mm with the intensity contrast method (0.92% of the total range) and an σ0 of 0.76 mm over a depth range of 135 mm with the differential contrast method (0.56% of the total range). Thus, the intensity contrast method is within the state-of-the-art DFD systems, whereas the differential contrast method allows, σ0 being almost equal, a remarkable extension of the depth range.

Keywords: Calibration | image edge analysis | image processing | lenses | phase modulation | shape measurement

Abstract: This work describes a simple, fast, and robust method for identifying, checking and managing the overlapping image keypoints for 3D reconstruction of large objects with numerous geometric singularities and multiple features at different lighting levels. In particular a precision 3D reconstruction of an extensive architecture captured by aerial digital photogrammetry using Unmanned Aerial Vehicles (UAV) is developed. The method was experimentally applied to survey and reconstruct the 'Saraceni' Bridge' at Adrano (Sicily), a valuable example of Roman architecture in brick of historical/cultural interest. The variety of features and different lighting levels required robust self-correlation techniques which would recognise features sometimes even smaller than a pixel in the digital images so as to automatically identify the keypoints necessary for image overlapping and 3D reconstruction. Feature Based Matching (FBM) was used for the low lighting areas like the intrados and the inner arch surfaces, and Area Based Matching (ABM) was used in conjunction to capture the sides and upper surfaces of the bridge. Applying SIFT (Scale Invariant Feature Transform) algorithm during capture helped find distinct features invariant to position, scale and rotation as well as robust for the affinity transformations (changes in scale, rotation, size and position) and lighting variations which are particularly effective in image overlapping. Errors were compared with surveys by total station theodolites, GPS and laser systems. The method can facilitate reconstruction of the most difficult to access parts like the arch intrados and the bridge cavities with high correlation indices.

Keywords: Architectural reconstruction | Area Based Matching | Feature Based Matching | Photogrammetry | SIFT algorithm

Abstract: The paper deals with an experimental assessment of the Leap Motion Controller®. This device is able to track the user’s hands in a real environment. Due to low-invasiveness and easiness of use, it is promising for the integration in virtual or augmented reality, research and entertainment scenarios. The assessment is performed in a real context using volunteers that were asked to point with the fingertips to a set of predefined locations in space. A specific test rig has been designed and built. It is comprised of a transparent plate supported by adjustable pillars and mounted over the Leap. The data are processed to assess the errors in tracking the five fingertips of the right hand. Results show that the accuracy and precision of the Leap is suitable for robust tracking of the user’s hand. The results also unveil that there are preferable zones in which the tracking performance is better.

Keywords: Leap controller | Motion capture | Natural interface | Tracking | User interaction

Abstract: The paper explores the possibility of using low-cost motion capture technologies to automatically evaluate patient’s condition concerning his/her walking condition. Two different technologies, optical markerless and inertial, are used to track the gait to be adopted in a doctor’s office or at patient’s home. The data acquired are elaborated using commercial and in-house developed tools with the aim of creating, in a near future, a simple environment for medical staff and people non highly skilled in IC technology. The paper shows the feasibility of an automatic detection of a set of gait abnormalities affecting people having a lower limb prosthesis. This constitutes a robust support for orthopedic technicians work and foresees the use of such technology for larger surveys and early detection of gait deviations.

Keywords: Gait Analysis | Inertial sensors | Motion Capture | RGB-D sensors

Abstract: A family of 26 non-parametric texture descriptors based on Histograms of Equivalent Patterns (HEP) has been tested, many of them for the first time in remote sensing applications, to improve urban classification through object-based image analysis of GeoEye-1 imagery. These HEP descriptors have been compared to the widely known texture measures derived from the gray-level co-occurrence matrix (GLCM). All the five finally selected HEP descriptors (Local Binary Patterns, Improved Local Binary Patterns, Binary Gradient Contours and two different combinations of Completed Local Binary Patterns) performed faster in terms of execution time and yielded significantly better accuracy figures than GLCM features. Moreover, the HEP texture descriptors provided additional information to the basic spectral features from the GeoEye-1’s bands (R, G, B, NIR, PAN) significantly improving overall accuracy values by around 3%. Conversely, and in statistic terms, strategies involving GLCM texture derivatives did not improve the classification accuracy achieved from only the spectral information. Lastly, both approaches (HEP and GLCM) showed similar behavior with regard to the training set size applied.

Keywords: GeoEye-1 | Histograms of equivalent patterns | OBIA | Texture

Abstract: The size distribution of aggregates has direct and important effects on fundamental properties of construction materials such as workability, strength and durability. The size distribution of aggregates from construction and demolition waste (C&D) is one of the parameters which determine the degree of recyclability and therefore the quality of such materials. Unfortunately, standard methods like sieving or laser diffraction can be either very time consuming (sieving) or possible only in laboratory conditions (laser diffraction). As an alternative we propose and evaluate the use of image analysis to estimate the size distribution of aggregates from C&D in a fast yet accurate manner. The effectiveness of the procedure was tested on aggregates generated by an existing C&D mechanical treatment plant. Experimental comparison with manual sieving showed agreement in the range 81-85%. The proposed technique demonstrated potential for being used on on-line systems within mechanical treatment plants of C&D.

Keywords: Construction and demolition waste | Image analysis | Particle size distribution | Texture

Abstract: Innovation of fashion-related products implies the continuous search for new and appealing shapes and materials in a short period of time due to the seasonality of the market. The design and manufacturing of such products have to deal with a dimensional variability as a consequence of the new shapes. An additional difficulty concerns properly forecasting the technological behaviour of the new materials in relation to the manufacturing process phases. The control of dimensional variations requires time and resource intensive activities. Human's manual and visual inspection solutions are more common than automatic ones for performing such control, where skilled operators are typically the only ones capable of immediately facing non-standard situations. The full control of such variations is even more subtle and mandatory in the field of spectacles, which are fashion-related products and also medical devices. This paper describes an inspection system developed to monitor the dimensional variations of a spectacles frame during the manufacturing process. We discuss the methodological approach followed to develop the system, and the experimental campaign carried out to test its effectiveness. The system intends to be an alternative to current inspection practices used in the field, and also to provide a methodological approach to enable engineers to systematically study the correlations existing among the frame main functional and dimensional parameters, the material behaviour and the technological variables of the manufacturing process. Hence, the system can be considered a method to systematically acquire and formalise new knowledge. The inspection system consists of a workbench equipped with four high-quality commercial webcams that are used to acquire orthogonal-view images of the front of the frame. A software module controls the system and allows the automatic processing of the images acquired, in order to extract the dimensional data of the frame which are relevant for the analysis. A case study is discussed to demonstrate the system performances.

Keywords: Eyewear industry | Image processing | Inspection systems | Knowledge-based engineering | Product variability

Abstract: The paper describes a system to supply meaningful insights to designers during the concept generation of new car interiors. The aim of the system is to capture the movements of car passenger's and making these acquisitions directly available as a generative input. The system has been developed by integrating the Abstract Prototyping technique with Motion Capture technology. In addition, a systematic procedure allows the treatment of the collected data to obtain a graphical representation, which can be easily used with standard NURBS-based modeling software. The effectiveness of the system has been evaluated through a testing session conducted with subjects. The outcomes of the testing sessions have highlighted benefits and limitations of the implemented system.

Keywords: Abstract prototyping | human factors | motion capture

Abstract: Digital documentation and high-quality 3D representation are always more requested in many disciplines and areas due to the large amount of technologies and data available for fast, detailed and quick documentation. This work aims to investigate the area of medium and small sized artefacts and presents a fast and low cost acquisition system that guarantees the creation of 3D models with an high level of detail, making the digitalization of cultural heritage a simply and fast procedure. The 3D models of the artefacts are created with the photogrammetric technique Structure From Motion that makes it possible to obtain, in addition to three-dimensional models, high-definition images for a deepened study and understanding of the artefacts. For the survey of small objects (only few centimetres) it is used a macro lens and the focus stacking, a photographic technique that consists in capturing a stack of images at different focus planes for each camera pose so that is possible to obtain a final image with a higher depth of field. The acquisition with focus stacking technique has been finally validated with an acquisition with laser triangulation scanner Minolta that demonstrates the validity compatible with the allowable error in relation to the expected precision.

Keywords: Cultural heritage | Focus stacking | Photogrammetry | Small artefacts | Structure from motion

Abstract: The diffusion of depth sensors to sense people and objects constitutes an outstanding opportunity in those fields in which the benefits of optical marker-less solutions for scanning or tracking are requested. This paper shows how two different applications based on MS Kinect device can be accomplished in the domain of lower limb prosthesis design and test. The first one refers to the use of a depth camera as a three-dimensional scanner to acquire the geometry of residual limbs or of custom-fit components. The second application is related to the motion capture of patients' gait with the prosthesis. In both cases, the technology resulted to be better than many traditional ones mainly for its limited invasivity, interesting performance, portability and low cost.

Keywords: 3D scanner | Digital human modelling | Lower limb prosthesis | Motion capture | RGB-D cameras

Abstract: The diffusion of depth sensors to sense people and objects constitutes an outstanding opportunity in those fields in which the benefits of optical marker-less solutions for scanning or tracking are requested. This paper shows how two different applications based on MS Kinect device can be accomplished in the domain of lower limb prosthesis design and test. The first one refers to the use of a depth camera as a three-dimensional scanner to acquire the geometry of residual limbs or of custom-fit components. The second application is related to the motion capture of patients' gait with the prosthesis. In both cases, the technology resulted to be better than many traditional ones mainly for its limited invasivity, interesting performance, portability and low cost.

Keywords: 3D scanner | Digital human modelling | Lower limb prosthesis | Motion capture | RGB-D cameras

Abstract: This paper presents a new methodology for computing grey-scale granulometries and estimating the mean size of fine and coarse aggregates. The proposed approach employs area morphology and combines the information derived from both openings and closings to determine the size distribution. The method, which we refer to as bipolar area morphology (BAM), is general and can operate on particles of different size and shape. The effectiveness of the procedure was validated on a set of 13 classes of aggregates of size ranging from 0.125 to 16 mm and made a comparison with standard, fixed-shape granulometry. In the experiments our model consistently outperformed the standard approach and predicted the correct size class with overall accuracy over 92 %. Tests on three classes from real samples also confirmed the potential of the method for application in real scenarios.

Keywords: Aggregates | Area morphology | Granulometry | Image analysis

Abstract: The injection of urea-water sprays within selective catalytic reduction systems is currently the leading technique for reducing the emission of nitrogen oxides from Diesel engines. For the process to work properly, it is crucial to guarantee the adequate size, velocity and distribution of the spray droplets upstream of the catalyst. It is therefore extremely important to understand the process of spray formation and evolution as well as possible. In this paper we describe a new methodology for inspecting the behaviour of urea-water sprays in realistic conditions. Our approach is based on a hot-air flow tunnel enabling optical inspection of the spray through phase-Doppler anemometry and back-light imaging. The procedure was employed to investigate the global and local characteristics of urea-water sprays under different flow conditions. The results proved the significant influence exerted by the flow conditions on the spray behaviour, and confirmed that the proposed system can provide considerable insight about the evolution of urea-water sprays. Cross-comparison of the droplet size estimated through phase-Doppler anemometry and back-light imaging showed substantial agreement between the two methods. This result suggests that back-light imaging is a viable alternative in those cases where complex exhaust geometry impedes the use of phase-Doppler anemometry.

Keywords: Image processing | Nitrogen oxides | Phase-Doppler anemometry | Selective catalytic reduction | Urea-water sprays

Abstract: In this work we propose the use of image features based on visual perception for discriminating epithelium and stroma in histological images. In particular, we assess the capability of the following five visual features to correctly discriminate epithelium from stroma in digitised tissue micro-arrays of colorectal cancer: coarseness, contrast, directionality, line-likeliness and roughness. The use of features directly related to human perception makes it possible to evaluate the tissue's appearance on the basis of a set of meaningful parameters; moreover, the number of features used to discriminate epithelium from stroma is very small. In the experiments we used histologically-verified, well-defined images of epithelium and stroma to train three classifiers based on Support Vector Machines (SVM), Nearest Neighbour rule (1-NN) and Naïve Bayes rule (NB). We optimised SVM's parameters on a validation set, and estimated the accuracy of the three classifiers on a independent test set. The experiments demonstrate that the proposed features can correctly discriminate epithelium from stroma with state-of-the-art accuracy.

Keywords: Colorectal cancer | Epithelium | Image analysis | Perceptual features | Stroma

Abstract: Human movements express non-verbal communication: The way humans move, live and act within a space influences and reflects the experience with a product. The study of postures and gestures can bring meaningful information to the design process. This paper explores the possibility to adopt Motion Capture technologies to inform the design process and stimulate concept generation with an Experience Design perspective. Motion data could enable designers to tackle Experience-driven design process and come up with innovative designs. However, due to their computational nature, these data are largely inaccessible for designers. This study presents a method to process the raw data coming from the Motion Capture system, with the final goal of reaching a comprehensible visualization of human movements in a modelling environment. The method was implemented and applied to a case study focused on User Experience within the car space. Furthermore, the paper presents a discussion about the conceptualization of human movement, as a way to inform and facilitate Experience-driven design process, and includes some propositions of applicable design domains.

Keywords: Body tracking | Conceptual design | Data visualization | Motion capture | User experience

Abstract: Beyond ergonomic measurements, the study of human movements can help designers in exploring the rich, non-verbal communication of users’ perception of products. This paper explores the ability of human gestures to express subjective experiences and therefore, to inform the design process at its early stages. We will investigate the traditional techniques used in the Experience Design domain to observe human gestures, and propose a method to couple Experience-driven design approach with Motion Capture technique. This will allow integrating qualitative user observations with quantitative and measurable data. However, the richness of information that Motion Capture can retrieve is usually inaccessible for designers. This paper presents a method to visualize human motion data so that designers can make sense of them, and use them as the starting point for concept generation.

Keywords: Body Tracking | Concept design | Data visualization | Motion Capture | User experience

Abstract: Seagrass meadows are complex ecosystems representing an important source of biodiversity for coastal marine systems, but are subjected to numerous threats from natural and human-based influences. Due to their susceptibility to changing environmental conditions, seagrasses are habitually used in monitoring programmes as biological indicators to assess the ecological status of coastal environments. In this paper we used a non-destructive photo mosaicing technology to quantify seagrass distribution and abundance, and explore benefits of micro-cartographic analysis. Furthermore, the use of photogrammetric tools enhanced the method, which proved to be efficient due to its use of low-cost instruments and its simplicity of implementation. This paper describes the steps required to use this method in meadows of Posidonia oceanica, including: i) camera calibration procedures, ii) programming of video survey, iii) criteria to perform sampling activities, iv) data processing and micro-georeferenced maps restitution, and v) possible study applications.

Keywords: Mapping | Photo mosaicing | Photogrammetry | Posidonia oceanica | Seagrass | Underwater photography

Abstract: Pilling is an undesired defect of textile fabrics, consisting of a surface characterized by a number of roughly spherical masses made of entangled fibers. Mainly caused by the abrasion of fabric surface occurring during washing and wearing of fabrics, this defect needs to be accurately controlled and measured by companies working in the textile industry. Pilling measurement is traditionally performed using manual procedures involving visual control of fabric surface by human experts. Since the early nineties, great efforts in developing automatic and non-intrusive methods for pilling measurement have been made all around the world with the final aim of overcoming traditional, visual-based and subjective procedures. Machine Vision proved to be among the best options to perform such defect assessment since it provided increasingly performing measurement equipment and tools, serving the purpose of automatic control. In particular, a relevant number of interesting works have been proposed so far, sharing the idea of helping (or even replacing) traditional measurement methods using image processing-based ones. The present work provides a rational and chronological review of the most relevant methods for pilling measurement proposed so far. This work serves the purposes of 1) understanding whether today’s automatic machine vision-based pilling measurement techniques are ready for supplanting traditional pilling measurement and 2) providing textile technology researchers with a bird’s eye view of the main methods studied to confront with this problem.

Keywords: Artificial neural networks | Fabrics | Image processing | Machine vision | Pilling assessment | Review

Abstract: First target of this paper is to describe the design the behaviour of the final prototype before its manufacturing of an automotive semi-active differential based on the use of a and to predict its good performances and possible Magnetorheological Fluid (MRF). The MRF allows to control weaknesses. So the costs and the time to market of the new the locking torque and, consequently, to improve the vehicle handling. Second target is to propose a method grounded on a Close-Range Photogrammetry approach for the CAD modeling phase of the device ideated, alternative to the use of the typical Reverse Engineering (RE) techniques. In fact, although a Reverse Engineering process allows the complete 3D reconstruction of the external surfaces and features of a real object, it could often take a lot of time and, in some cases, could be affected by some approximations or errors. Furthermore, a model “reconstructed” could not be the best solution for multiphysics analyses, where the parametric geometry is needed for the modifications of all its features and dimensions for the optimization process in a very short time. For these reasons, in the case studied, the complete CAD prototype, created step by step, is needed and the photogrammetry can represent an interesting solution to enhance the virtual prototyping phase without repercussions on the quality of the results. Starting from the acquisition of particular “key points”, with an acceptable tolerance, the definition of the references (datum axes, curves, planes, centres of holes) needed for the CAD modeling, according to the Top-Down procedure, was possible. Once obtained the preliminary prototype, the final CAD model was created optimizing its dimensions and choosing the adequate materials. To evaluate the goodness of the procedure adopted, the MRF LSD geometry was reconstructed also by means of the Reverse Engineering techniques applied to the physical prototype of the new device ad hoc created. In particular, laser system acquisition and RE dedicated software were used. In this way the comparison between the photogrammetric and Reverse Engineering procedures (in terms of time spent and quality of the results) was allowed and so conducted. Lastly, the results of the FEM analyses carried out to validate the design process and the methodology ideated and adopted were showed.

Keywords: 3D CAD parametric modeling | Automotive differential | Direct modeling | FEM analysis | Magnetorheological fluid | Photogrammetry | Reverse engineering

Abstract: Motion capture of the human body has being performed for decades with a growing number of technologies, aims and application fields; but only recent optical markerless technologies based on silhouette recognition and depth sensors which have been developed for videogames control interface have brought motion capture to a broad diffusion. Actually, nowadays there are low cost hardware and software suitable for a wide range of applications that may vary from entertainment domain (e.g., videogames, virtual characters in movies) to the biomechanical and biomedical domain (e.g., gait analysis or orthopedic rehabilitation) and to a huge number of industrial sectors. In this quick evolving scenario it is hard to tell which technology is the most suitable for any desired goal. The aim of the paper is to answer to this issue by presenting a benchmark analysis that compares RGB and RGB-D technologies used to track performing people in a variety of conditions. In order to contrast the solutions, several different tasks have been selected, simultaneously captured and post-processed exactly in the same way. The test campaign has been designed to evaluate pros and cons according to the most important feature of a motion capture technology, such as volume of acquisition, accuracy of joint position and tracking of fast movements. Actors were asked to perform a number of tasks, among which free movements of arms, legs and full body, gait, and tasks performed interacting with a machine. The number of sensors around the scene and their disposition have been considered as well. We used Sony PS Eye cameras and Microsoft Kinect sensors as hardware solutions and iPisoft for data elaboration. The gathered results are organized, compared and discussed stressing performances and limitations of any combination and, at last, we proposed the best candidate technology for some key applications.

Keywords: Benchmark | Depth cameras | Digital Human Models | Motion capture | RGB | RGB-D

Abstract: Pilling is a complex property of textile fabrics, representing, for the final user, a non-desired feature to be controlled and measured by companies working in the textile industry. Traditionally, pilling is assessed by visually comparing fabrics with reference to a set of standard images, thus often resulting in inconsistent quality control. A number of methods using machine vision have been proposed all over the world, with almost all sharing the idea that pilling can be assessed by determining the number of pills or the area occupied by the pills on the fabric surface. In the present work a different approach is proposed: instead of determining the number of pills, a machine vision-based procedure is devised with the aim of extracting a number of parameters characterizing the fabric. These are then used to train an artificial neural network to automatically grade the fabrics in terms of pilling. Tested against a set of differently pilled fabrics, the method shows its effectiveness.

Keywords: Computational vision | Image processing | Machine vision system | Neural networks | Pilling | Textile industry

Abstract: Design of products characterized by high stylistic content and organic shapes in the form of bas-relief (e.g. fashion accessories, commemorative plaques and coins) is traditionally performed starting from handmade drawings or photographs that are manually reproduced by highly skilled craftsmen such as sculptors and engravers and finally digitized by means of 3D scanning. Several Computer-based procedures have been devised with the aim of speeding up this process, which is considerably time consuming, subjective and costly; these are mainly based on image processing techniques such as embossing, enhancement, histogram equalization or dynamic range, also implemented in CAD-based commercial software. However, these approaches are characterized by several limitations preventing them from providing a "correct" final geometry. In view of that, the present work describes a novel method for the creation of digital bas-reliefs from a single image using a Shape From Shading (SFS) based approach with interactive initialization. Image processing-based techniques and minimization SFS methods are first used in order to retrieve a rough version of the objective surface; successively, this is used as initialization for the final reconstruction algorithm. Tested on a set of case studies, the method proved to be effective in providing satisfactory digital bas-relief from single images. © 2013 © 2013 CAD Solutions, LLC.

Keywords: digital bas-relief | image processing | shape from shading | shape retrieval

Abstract: Texture analysis is an area of intense research activity. Like in other fields, the availability of public data for benchmarking is vital to the development of the discipline. In "Texture databases - A comprehensive survey", Hossain and Serikawa recently provided a precious review of a good number of texture datasets, and put an order into this scattered field. The aim of this appendix is to complement the cited work by providing reference to additional image databases of bio-medical textures, textures of materials and natural textures that have been recently employed in experiments with texture analysis. There is in fact a good number of little-known texture databases which have very interesting features, and for this reason are likely to receive increasing attention in the near future. We are convinced that this extension, along with the original article, will be useful to many researchers and practitioners working in the field of texture analysis. © 2014 Elsevier B.V. All rights reserved.

Keywords: Bio-medical images | Database | Materials | Texture

Abstract: We present a sequential, two-step procedure based on machine vision for detecting and characterizing impurities in paper. The method is based on a preliminary classification step to differentiate defective paper patches (i.e., with impurities) from non-defective ones (i.e., with no impurities), followed by a thresholding step to separate the impurities from the background. This approach permits to avoid the artifacts which occur when thresholding is applied to paper samples that contain no impurities. We discuss and compare different solutions and methods to implement the procedure and experimentally validate it on a datasets of 11 paper classes. The results show that a marked increase in detection accuracy can be obtained with the two-step procedure in comparison with thresholding alone. © 2013 Elsevier B.V. All rights reserved.

Keywords: Image processing | Machine vision | Paper

Abstract: The perception of haptic textures depends on the mechanical interaction between a surface and a biological sensor. A texture is apprehended by sliding one’s fingers over the surface of an object. We describe here an apparatus that makes it possible to record the mechanical fluctuations arising from the friction between a human fingertip and easily interchangeable samples. Using this apparatus, human participants tactually scanned material samples. The analysis of the results indicates that the biomechanical characteristics of individual fingertips clearly affected the mechanical fluctuations. Nevertheless, the signals generated for a single material sample under different conditions showed some invariant features. We propose that this apparatus can be a valuable tool for the analysis of natural haptic surfaces.

Keywords: Apparatus | Biomechanics | Biotribology | Humans | Texture

Abstract: A systematic characterisation of the porosity in the bulk and surface regions of a sintered Cr-Mo low alloy steel was carried out using image analysis. Fractional porosity in the different regions varies, mainly due to the scatter of the maximum pore size. A higher porosity is found in the bulk region and lower porosity in the regions that contact the die surface during compaction. The maximum pore size is larger in the bulk region than in the surface layers. The large pores are more irregular. With increasing green density, both the fractional porosity and maximum pore size decrease. The fraction of load bearing section in the bulk and surface regions was calculated from fractional porosity and the shape factor of the pores and compared in the different regions. The load bearing section fraction and the maximum pore size were used to predict tensile and fatigue resistance for different densities. The data from the characterisation of the bulk images can predict tensile strength. For fatigue, where the crack nucleates in the surface regions, the use of bulk data underestimates the fatigue resistance. © 2014 Elsevier Inc.

Keywords: Image analysis | Mechanical properties | Porosity | Sintered steels

Abstract: In this article, a methodology to analyze the shear behavior of aluminum foam with closed cells is proposed. A biaxial load device was expressly designed and the elaboration with digital image correlation technique of the data acquired during the test with a charge coupled device (CCD) camera allowed determining the displacement and strain fields. This procedure made it possible to evaluate the procedure as suitable or not for conducting a shear characterization for metallic foam. The τ-γ curves obtained showed an initial elastic outline followed by the yield plateau, a peak load, and a rapid load drop. © 2014 Copyright Taylor & Francis Group, LLC.

Keywords: Aluminum foam | digital image correlation | shear characterization

Abstract: In the last years the development of interactive Computer-based methods for building virtual and physical 2.5D models from single shaded images faced with an exponential growth. In particular, a wide range of methods based on image processing-based procedures and on Shape From Shading (SFS) can be documented. On the basis of the most favorable techniques devised in literature, the present work describes an improved interactive method capable of retrieving 2.5D models using image shading information. The pro-posed method performs a SFS-based reconstruction where (1) the overall geometry of the expected surface is first recovered and (2) the final 2.5D reconstruction is obtained by minimizing a suitable functional using the rough surface as an initialization function. The method improves previous interactive works by introducing a novel two-step rough surface recovery and a new definition of a functional to be minimized for solving the SFS problem. Tested against a set of case studies the proposed method proves to be effective in providing 2.5D models. © 2014 Science Publications.

Keywords: 2.5D model | Image processing | Interactive reconstruction | Minimization | Shape from shading

Abstract: The visual appearance of seamless dyed edges of luxury leather goods represents a key issue in terms of quality grading since a high-quality leather has to be characterised by homogeneously coloured and shaped edges with uniform ink thickness. Despite a huge literature produced by scientific and technical community to automate many leather manufacturing processes, since leather patches are often characterised by a free-form shape, any attempt of automating leather edges dyeing produced unsatisfactory and inaccurate results. In order to overcome the drawbacks of the existing approaches, the main objective of the present work is to provide a computer-based system for automatically dyeing leather patches edges. The described system includes: 1) a machine vision (MV) hardware equipment, consisting of both illumination and a high resolution acquisition device, devoted to patches edge detection; 2) a pantograph whose dyeing tool is moved along leather edges; 3) a series of computer-based methods for the automatic extraction of the leather patches outlines. Extensive testing performed using the developed machine demonstrated its effectiveness in delivering fast, automatic and high quality edge finishing in a reliable and repeatable way. © 2014 Inderscience Enterprises Ltd.

Keywords: Leather dyeing | Machine vision | Process automation

Abstract: Wheel alignment, consisting of properly checking the wheel characteristic angles against vehicle manufacturers' specifications, is a crucial task in the automotive field since it prevents irregular tyre wear andaffects vehicle handling and safety. In recent years, systems based on Machine Vision have been widely studied in order to automatically detect wheels' characteristic angles. In order to overcome the limitations of existing methodologies, due to measurement equipment being mounted onto the wheels, the present work deals with design and assessment of a 3D machine vision-based system for the contactless reconstruction of vehicle wheel geometry, with particular reference to characteristic planes. Such planes, properly referred to as a global coordinate system, are used for determining wheel angles. The effectiveness of the proposed method was tested against a set of measurements carried out using a commercial 3D scanner; the absolute average error in measuring toe and camber angles with the machine vision system resulted in full compatibility with the expected accuracy of wheel alignment systems. © 2013 Furferi et al.

Keywords: Machine vision | Stereovision | Wheel alignment

Abstract: Automatic detection and assessment of dirt particles in pulp and paper plays a pivotal role in the papermaking industry. Traditional visual inspection by human operators is giving the way to machine vision, which provides many potential advantages in terms of speed, accuracy and repeatability. Such systems make use of image processing algorithms which aim at separating paper and pulp impurities from the background. The most common approach is based on image thresholding, which consists of determining a set of intensity values that split an image into one or more classes, each representing either the background (i.e.: An area with no defects) or an area with some types of contraries. In this paper we present a quantitative experimental evaluation of four image thresholding methods (i.e.: Otsu's, Kapur's, Kittler's and Yen's) for dirt analysis in paper. The results show that Kittler's method is the most stable and reliable for this task. © 2013 DIME UNIVERSITÀ DI GENOVA.

Keywords: Image thresholding | Machine vision | Paper | Quality assessment

Abstract: Foams and porous materials with cellular structure have many interesting combinations of physical and mechanical properties coupled with low specific weight. By means of replication casting it is possible to manufacture foams from molten metal without direct foaming. A soluble salt is used as space holder, which is removed by leaching in water. This can be done successfully if the content of space holding fillers is so high that all the granules are interconnected. One of the main advantages of using the replication casting is a close control of pore sizes which is given by the distribution of particle sizes of the filler material. This contrasts with the pore size distribution of the materials foamed by other processes where a wider statistical distribution of pores is found. On the other hand, the maximum porosities that can be achieved using space holders are limited to values below 60%, whereas the other methods allow for porosities up to 98%. Temperature of the mould and infiltration pressure are critical process parameters: a typical problem encountered is the premature solidification of the melt, especially due to the high heat capacity of the salt. In this work foam properties such as cell shape, distribution and anisotropy and defect presence are investigated by using digital image processing technique. For this purpose replicated AlSi7Mg0.3 alloy foams are produced by infiltrating preforms of NaCl particles, varying the metal infiltration pressure and the mould preheating temperature. An original procedure based on image analysis has been set up to determine size, morphology and distribution of cells. The paper demonstrates that this methodology, coupled with microstructural analysis, is a useful tool for investigating the effects of process parameters on foam properties.

Keywords: Aluminium foams | Foam morphology | Image analysis | Replication casting | Watershed method

Abstract: Furniture glass tiles are increasingly used for covering walls and facades or for conferring fashionable aesthetical properties to buildings. Companies that produce furniture glass tiles of a desired colour are devoted to performing a colour comparison between the manufactured glass tiles and the ones desired by a customer, or provided by a catalogue. Still today, such a comparison, known as 'colour matching', is mainly performed by company experts by means of a visual inspection, thus leading to a subjective and qualitative colour assessment. A number of methods for colour matching have been afforded in the literature in several industrial fields such as textile, plastics or food; unfortunately, to the best of author's knowledge, no practical method for glass tiles colour matching has been devised until today. The present work provides an image processing-based method capable of carrying out nonpatterned glass tiles colour matching. The method is devised using an appositely developed hardware so as to extract a series of statistical data from scanned images of 10 mm sized glass tiles and, on the basis of the definition of two novel colour distance formulas, endows with colour matching. The achieved colour matching performance agrees in 91% of tests with expertperformed colour classification. The provided formulas are meant to be of general usage for assessing glass tiles colour matching. © RPS 2013.

Keywords: Colour gaussian | Colour matching | Glass | Image processing | Mahalanobis

Abstract: This paper is about the development of an expert system for automatic classification of granite tiles through computer vision. We discuss issues and possible solutions related to image acquisition, robustness against noise factors, extraction of visual features and classification, with particular focus on the last two. In the experiments we compare the performance of different visual features and classifiers over a set of 12 granite classes. The results show that classification based on colour and texture is highly effective and outperforms previous methods based on textural features alone. As for the classifiers, Support Vector Machines show to be superior to the others, provided that the governing parameters are tuned properly. © 2012 Elsevier Ltd. All rights reserved.

Keywords: Classification | Colour | Grading | Granite | Texture

Abstract: Yarn hairiness and yarn hand represent key parameters to be strictly assessed and controlled in textile processes since they affect many aspects such as visual appearance of yarns (and consequently of fabrics), handle, thermal insulation, pleasant sensation during touch and smoothness. This is particularly true when fancy yarns, such as jaspè or frisè, are produced using ring spinning: colored natural fibers composing the fancy yarns are required to protrude, to some extent, from the yarn core, usually composed by synthetic material, so as to impart the desired properties in terms of smoothness and luster. With the aim of realizing highest performing fancy yarns, a novel ring spinning system, equipped with a double drafting unit, has been realized by Università di Firenze thanks to the contribute of Tuscany Region (Italy). Once the fancy yarns are obtained, the performance of this innovative ring spinning is evaluated by means of a Computer Aided analysis of yarn geometry able to provide a novel measurement of yarn hairiness and to quantitatively define a yarn hand-related parameter. A Machine Vision system has been devised in order to acquire yarn geometry so that an accurate analysis can be carried out. Such computer aided-based analysis allows to determine two parameters used for determining hairiness and hand: the "equivalent yarn hairiness" and the "yarn hand index". Such parameters are evaluated for yarns obtained using both the innovative and a conventional ring spinning machine so that the yarns quality can be effectively compared. Based on the obtained results that the proposed method proved to be suitable and effective for evaluating yarn hairiness within an average error of about 5.40% with respect to the Uster tester. Furthermore, a good correlation (93%) between objective and subjective assessment of yarn hand was reached.

Keywords: Computer Aided analysis | Image processing | Yarn geometry | Yarn hairiness | Yarn hand

Abstract: Current research on underwater 3D imaging methods is mainly addressing long range applications like seafloor mapping or surveys of archeological sites and shipwrecks. Recently, there is an increasing need for more accessible and precise close-range 3D acquisition technologies in some application fields like, for example, monitoring the growth of coral reefs or reconstructing underwater archaeological pieces that in most cases cannot be recovered from the seabed. This paper presents the first results of a research project that aims to investigate the possibility of using active optical techniques for the whole-field 3D reconstructions in an underwater environment. In this work we have tested an optical technique, frequently used for in air acquisition, based on the projection of structured lighting patterns acquired by a stereo vision system. We describe the experimental setup used for the underwater tests, which were conducted in a water tank with different turbidity conditions. The tests have evidenced that the quality of 3D reconstruction is acceptable even with high turbidity values, despite the heavy presence of scattering and absorption effects. © 2011 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS).

Keywords: 3D reconstruction | Imaging in turbid medium | Photogrammetry | Structured light | Underwater imaging

Abstract: Chronic wounds represent a particular debilitating health care problem, mainly affecting elderly people. A full and correct diagnosis of tissue damage should be carried out considering both dimensional, chromatic, and thermal parameters. A great variety of methods have been proposed with the aim of producing objective assessment of skin lesions, but none of the existing technologies seem to be robust enough to work for all ulcer typologies. This paper describes an innovative and non-invasive system that allows the automatic measurement of non-healing chronic wounds. The methodology involves the integration of a three-dimensional (3D) optical scanner, based on a structured light approach, with a thermal imager. The system enables the acquisition of geometrical data, which are directly related to chromatic and temperature patterns through a mapping procedure. Damaged skin areas are detected by combining visible and thermal imaging. This approach allows for the automatic measurement of extension and depth of ulcers, even in the absence of significant and well-defined chromatic patterns. The proposed technology has been tested in the measurement of ulcers on human legs. Clinical tests have demonstrated the effectiveness of this methodology in supporting medical experts for the assessment of chronic wounds. © 2011 Authors.

Keywords: 3D model reconstruction | 3D thermography | image processing | wound assessment

Abstract: It is well-known that local binary pattern (LBP) histograms of real textures exhibit a markedly uneven distribution, which is dominated by the so-called uniform patterns. The widely accepted interpretation of this phenomenon is that uniform patterns correspond to texture microfeatures, such as edges, corners, and spots. In this paper we present a theoretical study about the relative occurrence of LBPs based on the consideration that the LBP operator partitions the set of grayscale patterns into an ensemble of disjoint multidimensional polytopes. We derive exact prior probabilities of LBPs by calculating the volume of such polytopes. Our study puts in evidence that both the uneven distribution of the LBP histogram and the high occurrence of uniform patterns are direct consequences of the mathematical structure of the method rather than an intrinsic property of real textures. © 2011 Springer Science+Business Media, LLC.

Keywords: Local binary patterns | Polytopes | Texture

Abstract: Digital applications such as CG, CAD and GIS are based on vectorial data since all the information about shape, size, topology etc. are provided in such kind of data representation rather than raster one. Turning raster images into vector ones is a key issue which has been addressed by a number of authors but still far to be exhaustively worked out. Especially in the case of 2D images representing technical drawings, fitting analytical curves to point clouds (pixel sets) is a critical matter. The present paper provides a novel approach to fit unordered point cloud data. Such an approach integrates a PCA-based method, for detecting the main local directions of the point cloud and to order the points, with and a weighted approximation of a B-spline curve to the original data, based on pixel gray levels. The methodology, tested against alternative techniques based on Least Square (LS) B-spline approximation and on image thinning, proved to be effective in preserving the original shape according to human perception.

Keywords: Curve reconstruction | Image processing | PCA | Unorganized points | Weighted least-squares

Abstract: An automatic 3D model retrieval from freehand conceptual sketches is a key target for both commercial software houses and academic research. Unfortunately, most of the approaches are not suitable for properly translating stylistic sketches into 3D models. In order to carry out this 3D model conversion, the first task to be dealt with is to turn raster data (3D or 2D free-form curves) into vectorial ones. Such a task represents a key issue which has been addressed by a number of authors but still far to be exhaustively worked out. To address this challenge, this work presents a new method that allows to fit 2D unordered point cloud data with Multiple Incident Splines (MISs). At the heart of the proposed approach are two main procedures: the first one is based on Euclidean Minimum Spanning Tree (EMST) and Principal Component Analysis (PCA) for detecting the main local directions of the point cloud and to order its points while preserving original topology; the second is meant to fit ordered point clouds with spline curves providing a robust intersection and vertex detection. The proposed methodology, tested on a number of case studies, proves to preserve the original topology more efficiently than alternative techniques supplied by commercial vectorization software packages.

Keywords: Curve reconstruction | Freehand sketches | Image Processing | Styling | Unorganized point cloud

Abstract: Car seat fabrics are uniquely fashioned textiles. A number of them is branded by a sponged-like appearance, characterized by spots and slightly discoloured areas. Their surface anisotropy is considered to be a relevant aesthetic feature since it has a strong impact on customer perceived quality. A first-rate car seat fabric requires a "small" quantity of spots and discoloured areas while fabrics characterized either by a large number or by a low number of spots, are considered to be of lower quality. Therefore, car seat fabric quality grading is a relevant issue to be dealt with downstream to the production line. Nowadays, sponged-like fabric grading is performed by human experts by means of manual inspection and classification; though this manual classification proves to be effective in fabric grading, the process is subjective and its results may vary depending on the operator skills. Accordingly, the definition of a method for the automatic and objective grading of sponged-like fabrics is necessary. The present work aims to provide a computer-based tool capable of classifying sponged-like fabrics, as closely as possible to classifications performed by skilled operators. Such a tool, composed by an appositely devised machine vision system, is capable of extracting a number of numerical parameters characterizing the fabric veins and discoloured areas. Such parameters are, then, used for training an Artificial Neural Network (ANN) with the aim of classifying the fabrics in terms of quality. Finally, a comparison between the ANN-based classification and the one provided by fabric inspectors is performed. The proposed method, tested on a validation set composed by 65 sponged-like fabrics, proves to be able to classify the fabrics into the correct quality class in 93.8% of the cases, with respect to the selection provided by human operators.

Keywords: Artificial neural networks | Car seat fabrics | Grading | Machine vision

Abstract: Classification of wasted woollen textiles on the basis of their colour is a basic approach for the supply of a raw material which does not involve the cost of the colouring process. Colour classification is a very difficult task, especially when a fabric is composed by differently coloured fibre (melange fabric). Many systems have been developed in the last years for colour classification of textiles. Unfortunately such colour classification systems are not able to correctly classify melange fabrics. In the present work a method for real-time classification of melange colour woollen fabrics is proposed. The provided approach, that is suitable also for classifying solid colour fabrics, integrates a Machine Vision (MV) system, able to acquire high resolution images, with a clustering algorithm capable of mapping the colour pixel of fabric images into a series of colour classes. The proposed system provides a colour classification with a misclassification less than 10% when compared with the classification resulting from apanel of expert human operators. A comparison between the proposed method and some tools stated in scientific literature is also afforded. © 2011 Asian Network for Scientific Information.

Keywords: Machine vision | Mapping | Melange | Recycling | Textiles

Abstract: In this paper we study the feasibility of developing a search engine capable of retrieving images from a granite image database based on a query image that is similar to the intended targets. The main focus was on the determination of the set of colour and/or texture features which yields highest retrieval accuracy. To assess the performance of the considered image descriptors we created a granite image database, formed by images recorded at our laboratory as well as taken from the Internet. Experimental results show that colour and texture features can be successfully employed to retrieve granite images from a database. We also found that improved accuracy is achieved by combining different colour and texture feature sets through classifier fusion schemes.

Keywords: CBIR | Colour | Granite | Image retrieval systems | Texture | Visual appearance

Abstract: This work describes an automated artificial vision inspection (AVI) system for real-time detection and classification of defects on textile raw fabrics. The tool (software + hardware) is directly attached to an appositely developed appraisal equipment machine (weave room monitoring system) and the inspection is performed online. The developed tool performs (1) the image acquisition of the raw fabric, (2) the extraction of some critical parameters from the acquired images, (3) an artificial neural network (ANN)-based approach able to detect and classify the most frequently occurring types of defects occurring on the raw fabric and (4) a standard image processing algorithm that allows the measurement of the geometric properties of the detected defects. The reliability of the tool is about 90% (defect detected vs. effectively existing defects), that is, similar to the performance obtained by human experts. Once detected the defects are correctly classified in 88% of cases and their geometrical properties are measured with a sub-pixel precision.

Keywords: Artificial neural network | Image processing | Raw fabrics | Real time

Abstract: A reliable prediction of ductile failure in metals is still a wide-open matter of research. Several models are available in the literature, ranging from empirical criteria, porosity-based models and continuum damage mechanics (CDM). One major issue is the accurate identification of parameters which describe material behavior. For some damage models, parameter identification is more or less straightforward, being possible to perform experiments for their evaluation. For the others, direct calibration from laboratory tests is not possible, so that the approach of inverse methods is required for a proper identification. In material model calibration, the inverse approach consists in a non-linear iterative fitting of a parameter-dependent load-displacement curve (coming from a FEM simulation) on the experimental specimen response. The test is usually a tensile test on a round-notched cylindrical bar. The present paper shows a novel inverse procedure aimed to estimate the material parameters of the Gurson-Tvergaard-Needleman (GTN) porosity-based plastic damage model by means of experimental data collected using image analysis. The use of digital image processing allows to substitute the load-displacement curve with other global quantities resulting from the measuring of specimen profile during loading. The advantage of this analysis is that more data are available for calibration thus allowing a greater level of confidence and accuracy in model parameter evaluation. © Springer Science+Business Media B.V. 2007.

Keywords: Damage mechanics | Image analysis | Inverse methods | Machine design | Parameter identification

Abstract: The present work presents the devising of a new highly automated artificial vision inspection (AVI) tool for real-time defect detection and classification on circular knitting machines. The tool is based on the combination of statistical analysis, Image Processing and an artificial neural network (ANN) approach. The tool (software + hardware) is directly attached to a circular knitting machine and the inspection is performed on-line during other common operations like laser cutting and ironing. The automatic inspection allows the real-time detection and classification of the most frequently occurring types of defects on knitted fabrics, which are significant for purposes of quality control and fabric grading. The reliability of the detection tool, i.e. the ratio between defect detected and effective defects is about 93%. The AVI system has been developed by the Department of Mechanical Engineering, University of Florence (Italy), and the textile research centre Tecnotessile s.r.l. of Prato (Italy).

Keywords: Image processing | Knitting machines | Neural network | Radon transform | Real time | Skewness

Abstract: This work provides an automatic and non-intrusive tool to objectively monitoring the raising process by measuring the height and the density of the fibres emerging from a raised cloth (pile). These parameters are assessed by a numerical procedure, which elaborates the images provided by an appositely developed machine-vision system. The proposed approach allows the investigation and the control of the raising process and has been validated by experimental measurements performed on a set of specimens (cloths) with several raising degrees. The comparison between the results obtained by the proposed procedure and the ones coming from a widely accepted textile-measuring device (fabric assurance by simple testing, FAST) is also provided. © 2005 Elsevier B.V. All rights reserved.

Keywords: Cloth raising | Image processing | Machine-vision design | Pile density | Pile height

Abstract: In this paper the results of an experimental investigation on the effect of subcritical damage on the residual strength properties of notched composite laminates are presented. A procedure based on the digital image correlation method was applied to laminates subjected to static and fatigue tensile loading. The digital image correlation method (DICM) is a whole-field technique that calculates surface displacements and strains from digital images characterized by a random distribution of intensity grey levels. Graphite/PEEK (polyether ether ketone) and graphite/epoxy laminates with different stacking sequences were analysed and the damage progression near the stress riser was evaluated by means of the strain maps obtained by digital image correlation. It was found that damage developing before final fracture may significantly affect the structural performance of composite laminates. The digital image correlation technique allowed clarification of the beneficial or detrimental role played by the different failure mechanisms on the strain redistribution around the hole and, as a consequence, on the residual strength and fatigue life of notched samples. The findings of the investigation suggest that the DICM is an efficient and reliable tool for full-field monitoring and detailed damage characterization of structural composite elements. © IMechE 2005.

Keywords: Composite materials | Damage | Digital image correlation | Fatigue | Notch

Abstract: This paper presents a 3D optical digitiser based on an active stereo vision aproach. The system is composed of a digital camera, a multimedia projector and software to control the hardware and process the images. The proposed solution integrates an active coded light method with a photogrammetric procedure in order to allow the acquisition of complex surfaces. In the work, experimental tests have been conducted with a nominal model and styling components of two-wheeler vehicles. The measurement process and the experimental results have been analysed to verify usability and accuracy of the methodology.

Keywords: Coded light | Photogrammetry | Reverse Engineering | Stereovision

Abstract: This paper is concerned with small strain measurement utilizing the numerical processing of digital images. The proposed method has its theoretical basis in digital signal analysis and, from a methodological point of view, it can be considered as an extension to digital images of the well-known white light speckle photography technique. That conventional method is based on the analysis of photographic plates that are exposed twice (before and after the specimen deformation) with the image of a random speckle pattern that has been previously printed on the test piece surface. The digital speckle correlation advantages consist of requiring a very simple specimen preparation and, mainly, of allowing the strain field computation just by numerical elaboration of the acquired images. In this paper, the theoretical basis of the technique and some valuable improvements to the known analogous methodologies are presented. Finally, test results for an application of digital speckle correlation are shown and advantages and disadvantages of the technique are elaborated. In addition, further developments in this area are discussed.

Keywords: Image processing | Speckle correlation | Speckle methods | Speckle photography | Strain analysis

Abstract: This work illustrates a computer program designed to aid surgeons in selecting the hip prosthesis femoral component during the preoperation planning stage of hip replacement surgery. Starting from the processing of the patient's coxo-femoral region X-ray image, the program, called Hippin, interacts with the user to outline the femoral region, including the head and the inner contour of the proximal femur. It automatically examines all possible couplings with the patient's femur outlines from a database containing the outlines of the available prostheses created by digitizing the templates normally used in preoperation planning. The resulting images enable the surgeon to visually compare all the alternatives. In addition, the program provides numerical values for the distances between the physiological rotation and prosthesis centers, helping the surgeon in selecting from among the possibilities. The program has been validated by comparing the computer results with actual surgeon selections. (C) 2000 Elsevier Science Ireland Ltd.

Keywords: Hip prosthesis | Image processing | Preoperation planning

Abstract: The phase stepping technique has recently been applied to the automated analysis of photoelastic fringes to determine the isoclinic parameter and the relative retardation. Generally, in these methods the error of quarter-wave plates, due to common manufacturing tolerances, influences the determination of the isoclinic parameter and the fringe order. In this paper a new phase stepping method in which the influence of quarter-wave plate error is null on the isoclinic parameter and negligible on the fringe order is proposed. The theoretical results have been confirmed by experimental tests.

Keywords: Image processing | Phase stepping | Photoelasticity

Abstract: The analysis of bone-remodelling processes by means of the relative radiographic follow-up has been proven to be a useful clinical diagnostic tool. A previous study has introduced a computerized, automatic, video-densitometric analysis. The main point of this procedure is that it potentially allows an objective, quantitative analysis of bone remodelling processes. This assertion is addressed by the present study. In particular, this study attempts to assess the repeatability of this procedure and to identify the main sources of noise.

Keywords: Bone-remodelling | Design of experiments | Diagnostics | Digital radiography | Factorial plane | Hip prosthesis | Image processing | Robustness | Video-densitometric analysis