VanityX: An Agile 3D Rendering Platform Supporting Mixed Reality
VanityX is a prototype, low-level, real-time 3D rendering and computing platform. Unlike most XR solutions, which integrate several commercial and/or open-source products, such as game engines, XR libraries, runtime, and services, VanityX is a platform ready to adapt to any business domain including...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-04-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/9/5468 |
| _version_ | 1797603004398960640 |
|---|---|
| author | Ivan Zoraja Mirjana Bonkovic Vladan Papic Vaidy Sunderam |
| author_facet | Ivan Zoraja Mirjana Bonkovic Vladan Papic Vaidy Sunderam |
| author_sort | Ivan Zoraja |
| collection | DOAJ |
| description | VanityX is a prototype, low-level, real-time 3D rendering and computing platform. Unlike most XR solutions, which integrate several commercial and/or open-source products, such as game engines, XR libraries, runtime, and services, VanityX is a platform ready to adapt to any business domain including anthropology and medicine. The design, architecture, and implementation are presented, which are based on CPU and GPU asymmetric multiprocessing with explicit synchronization and collaboration of parallel tasks and a predictable transfer of pipeline resources between processors. The VanityX API is based on DirectX 12 and native programming languages C++20 and HLSL 6, which, in conjunction with explicit parallel processing, the asynchronous loading and explicit managing of graphic resources, and effective algorithms, results in great performance and resource utilization close to metal. Surface-based rendering, direct volume rendering (DVR), and mixed reality (MR) on the HoloLens 2 immersive headset are currently supported. Our MR applications are directly compiled and deployed to HoloLens 2 allowing for better programming experiences and software engineering practices such as testing, debugging, and profiling. The VanityX server provides various computational and rendering services to its clients running on HoloLens 2. The use and test cases are in many business domains including anthropology and medicine. Our future research challenges will primarily, via the MetaverseMed project, focus on opening new opportunities for implementing innovative MR-based scenarios in medical procedures, especially in education, diagnostics, and surgical operations. |
| first_indexed | 2024-03-11T04:24:03Z |
| format | Article |
| id | doaj.art-3a98609430814f4c8f248b396078ca17 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-11T04:24:03Z |
| publishDate | 2023-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-3a98609430814f4c8f248b396078ca172023-11-17T22:34:26ZengMDPI AGApplied Sciences2076-34172023-04-01139546810.3390/app13095468VanityX: An Agile 3D Rendering Platform Supporting Mixed RealityIvan Zoraja0Mirjana Bonkovic1Vladan Papic2Vaidy Sunderam3Zoraja Consulting, Spinčićeva 2E, 21000 Split, CroatiaFaculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, University of Split, Ruđera Boškovića 32, 21000 Split, CroatiaFaculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, University of Split, Ruđera Boškovića 32, 21000 Split, CroatiaDepartment of Mathematics and Computer Science, Emory University, 400 Dowman Dr., Atlanta, GA 30322, USAVanityX is a prototype, low-level, real-time 3D rendering and computing platform. Unlike most XR solutions, which integrate several commercial and/or open-source products, such as game engines, XR libraries, runtime, and services, VanityX is a platform ready to adapt to any business domain including anthropology and medicine. The design, architecture, and implementation are presented, which are based on CPU and GPU asymmetric multiprocessing with explicit synchronization and collaboration of parallel tasks and a predictable transfer of pipeline resources between processors. The VanityX API is based on DirectX 12 and native programming languages C++20 and HLSL 6, which, in conjunction with explicit parallel processing, the asynchronous loading and explicit managing of graphic resources, and effective algorithms, results in great performance and resource utilization close to metal. Surface-based rendering, direct volume rendering (DVR), and mixed reality (MR) on the HoloLens 2 immersive headset are currently supported. Our MR applications are directly compiled and deployed to HoloLens 2 allowing for better programming experiences and software engineering practices such as testing, debugging, and profiling. The VanityX server provides various computational and rendering services to its clients running on HoloLens 2. The use and test cases are in many business domains including anthropology and medicine. Our future research challenges will primarily, via the MetaverseMed project, focus on opening new opportunities for implementing innovative MR-based scenarios in medical procedures, especially in education, diagnostics, and surgical operations.https://www.mdpi.com/2076-3417/13/9/54683D platforms3D enginesasymmetric parallel computingsurface-based renderingdirect volume renderingmixed reality |
| spellingShingle | Ivan Zoraja Mirjana Bonkovic Vladan Papic Vaidy Sunderam VanityX: An Agile 3D Rendering Platform Supporting Mixed Reality Applied Sciences 3D platforms 3D engines asymmetric parallel computing surface-based rendering direct volume rendering mixed reality |
| title | VanityX: An Agile 3D Rendering Platform Supporting Mixed Reality |
| title_full | VanityX: An Agile 3D Rendering Platform Supporting Mixed Reality |
| title_fullStr | VanityX: An Agile 3D Rendering Platform Supporting Mixed Reality |
| title_full_unstemmed | VanityX: An Agile 3D Rendering Platform Supporting Mixed Reality |
| title_short | VanityX: An Agile 3D Rendering Platform Supporting Mixed Reality |
| title_sort | vanityx an agile 3d rendering platform supporting mixed reality |
| topic | 3D platforms 3D engines asymmetric parallel computing surface-based rendering direct volume rendering mixed reality |
| url | https://www.mdpi.com/2076-3417/13/9/5468 |
| work_keys_str_mv | AT ivanzoraja vanityxanagile3drenderingplatformsupportingmixedreality AT mirjanabonkovic vanityxanagile3drenderingplatformsupportingmixedreality AT vladanpapic vanityxanagile3drenderingplatformsupportingmixedreality AT vaidysunderam vanityxanagile3drenderingplatformsupportingmixedreality |