F. Rapp et al., "Feedback Mechanisms of an iOS App to Record RGBD Data for AI-Based Diagnosis and Monitoring of Infant Head Deformation", Proc. of 3DBODY.TECH 2022 - 13th Int. Conf. and Exh. on 3D Body Scanning and Processing Technologies, Lugano, Switzerland, 25-26 Oct. 2022, #39, https://doi.org/10.15221/22.39.

Title:

Feedback Mechanisms of an iOS App to Record RGBD Data for AI-Based Diagnosis and Monitoring of Infant Head Deformation

Authors:

Fabian RAPP 1, Samuel ZEITVOGEL 3, Christian MEDER 1, Kai STOEVESANDT 2, Christian WERNET 3, Astrid LAUBENHEIMER 3

1 inovex GmbH, Karlsruhe, Germany;
2 VARILAG GmbH & Co. KG, Ettlingen, Germany;
3 Intelligent Systems Research Group (ISRG), Karlsruhe University of Applied Sciences, Germany

Abstract:

We present a prototype of a 3D infant head reconstruction app on a mobile phone for a cranial asymmetry measurement method. In this work, we focus on the user experience and user feedback of the interactive reconstruction pipeline.
The advent of 3D sensor-equipped mobile phones such as the iPhone TrueDepth camera enables widespread 3D reconstruction and measurement applications such as room measurements for interior design preview and object reconstruction. Reconstructing an infant's head with an RGBD sequence is challenging due to the uncooperative behaviour of the subject.
The RGBD data for the scan is recorded with the TrueDepth camera system on the front of iPhones (starting with the iPhone X), which is normally used for FaceID. The forward-facing position of the sensor poses a challenge to the app operator because the screen is hardly visible during recording.
The major contribution of this work is an app providing audible, haptic and visual feedback to support the user during the scanning process. Furthermore, the app is designed to be easy to use following an intuitive user experience design. Lastly, the developed app is tested by a team of physical therapists to evaluate the feedback concept and the user experience.

Keywords:

3D, TrueDepth camera system, user feedback, CVAI measurement, scanning app

Details:

Full paper: 2239rapp.pdf
Proceedings: 3DBODY.TECH 2022, 25-26 Oct. 2022, Lugano, Switzerland
Paper id#: 39
DOI: 10.15221/22.39
Presentation video: 3DBodyTech2022_39_rapp.mp4

Copyright notice

© Hometrica Consulting - Dr. Nicola D'Apuzzo, Switzerland, hometrica.ch.
Reproduction of the proceedings or any parts thereof (excluding short quotations for the use in the preparation of reviews and technical and scientific papers) may be made only after obtaining the specific approval of the publisher. The papers appearing in the proceedings reflect the author's opinions. Their inclusion in these publications does not necessary constitute endorsement by the editor or by the publisher. Authors retain all rights to individual papers.

Note: click the + on the top left of the page to open/close the menu.