Hands Up! Towards Machine Learning Based Virtual Reality Arm Generation

Hands Up! Towards Machine Learning Based Virtual Reality Arm Generation

Abstract

This research paper presents a novel machine learning based approach for generating personalized arms for virtual reality use cases. The approach is fully automatic and not bound to expensive or specialized hardware. To overcome the big amount of data necessary to train machine learning models a synthetic data generation scheme is employed. It is then shown how an image to image machine learning model can be trained via this training data to extract personalized arm textures from only two photographs. Finally the resulting virtual arms are analyzed by conducting an experiment to measure the embodiment of test subjects using these personalized arms in a virtual reality environment. This work represents a notable advancement in the integration of machine learning with virtual reality. It offers a promising step towards more user-centric and immersive VR experiences without necessitating high-end hardware. The findings serve as a foundation for future research aimed at refining and expanding the applicability of personalized virtual environments.

Grafik Top
Authors
  • Martinek, Daniel
  • Pazour, Patrick
  • Mirk, David
  • Hlavacs, Helmut
Grafik Top
Shortfacts
Category
Paper in Conference Proceedings or in Workshop Proceedings (Paper)
Event Title
IEEE Gaming, Entertainment, and Media Conference (GEM) 2024
Divisions
Education, Didactics and Entertainment Computing
Subjects
Informatik in Beziehung zu Mensch und Gesellschaft
Event Location
Turin, Italy
Event Type
Conference
Event Dates
05.06. - 07.06.2024
ISSN/ISBN
9798350374537
Date
June 2024
Export
Grafik Top