Applying a Method for Augmenting Data Mixed from Two Different Sources Using Deep Generative Neural Networks to Management Science

Although a multimodal data analysis, comprising physiological and questionnaire survey data, provides better insights into addressing management science concerns, such as challenging the predictions of consumer choice behavior, studies in this field are scarce because of two obstacles: limited sampl...

Full description

Bibliographic Details
Main Authors: Shinya Watanuki, Yumiko Nomura, Yuki Kiyota, Minami Kubo, Kenji Fujimoto, Junko Okada, Katsue Edo
Format: Article
Language:English
Published: MDPI AG 2023-12-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/14/1/378
_version_ 1797359082817978368
author Shinya Watanuki
Yumiko Nomura
Yuki Kiyota
Minami Kubo
Kenji Fujimoto
Junko Okada
Katsue Edo
author_facet Shinya Watanuki
Yumiko Nomura
Yuki Kiyota
Minami Kubo
Kenji Fujimoto
Junko Okada
Katsue Edo
author_sort Shinya Watanuki
collection DOAJ
description Although a multimodal data analysis, comprising physiological and questionnaire survey data, provides better insights into addressing management science concerns, such as challenging the predictions of consumer choice behavior, studies in this field are scarce because of two obstacles: limited sample size and information privacy. This study addresses these challenges by synthesizing multimodal data using deep generative models. We obtained multimodal data by conducting an electroencephalography (EEG) experiment and a questionnaire survey on the prediction of skilled nurses. Subsequently, we validated the effectiveness of the synthesized data compared with real data regarding the similarities between these data and the predictive performance. We confirmed that the synthesized big data were almost equal to the real data using the trained models through sufficient epochs. Conclusively, we demonstrated that synthesizing data using deep generative models might overcome two significant concerns regarding multimodal data utilization, including physiological data. Our approach can contribute to the prevailing combined big data from different modalities, such as physiological and questionnaire survey data, when solving management issues.
first_indexed 2024-03-08T15:11:10Z
format Article
id doaj.art-884e3635f5ed44859c64b446296359f8
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-08T15:11:10Z
publishDate 2023-12-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-884e3635f5ed44859c64b446296359f82024-01-10T14:51:56ZengMDPI AGApplied Sciences2076-34172023-12-0114137810.3390/app14010378Applying a Method for Augmenting Data Mixed from Two Different Sources Using Deep Generative Neural Networks to Management ScienceShinya Watanuki0Yumiko Nomura1Yuki Kiyota2Minami Kubo3Kenji Fujimoto4Junko Okada5Katsue Edo6Department of Marketing, Faculty of Commerce, University of Marketing and Distribution Sciences, 3-1 Gakuen-Nishimachi, Nishi-ku, Kobe 651-2188, Hyogo, JapanDepartment of Nursing, Japanese Red Cross Hiroshima College of Nursing, 1-2 Ajinadai-Higashi, Hatsukaichi 738-0052, Hiroshima, JapanGraduate School of Comprehensive Scientific Research Program in Health and Welfare, Prefectural University of Hiroshima, 1-1 Gakuencho, Mihara 723-0053, Hiroshima, JapanHiroshima Red Cross Hospital Atomic-Bomb Survivors Hospital, 1-9-6 Sendamachi, Naka-ku, Hiroshima 730-8619, Hiroshima, JapanHiroshima Office, Survey Research Center Co., Ltd., 2-29 Tatemachi, Naka-ku, Hiroshima 730-0032, Hiroshima, JapanFaculty of Health and Welfare, Prefectural University of Hiroshima, 1-1 Gakuencho, Mihara 723-0053, Hiroshima, JapanHiroshima Business and Management School, Prefectural University of Hiroshima, 1-1-71 Ujina-Higashi, Minami-ku, Hiroshima 734-8558, Hiroshima, JapanAlthough a multimodal data analysis, comprising physiological and questionnaire survey data, provides better insights into addressing management science concerns, such as challenging the predictions of consumer choice behavior, studies in this field are scarce because of two obstacles: limited sample size and information privacy. This study addresses these challenges by synthesizing multimodal data using deep generative models. We obtained multimodal data by conducting an electroencephalography (EEG) experiment and a questionnaire survey on the prediction of skilled nurses. Subsequently, we validated the effectiveness of the synthesized data compared with real data regarding the similarities between these data and the predictive performance. We confirmed that the synthesized big data were almost equal to the real data using the trained models through sufficient epochs. Conclusively, we demonstrated that synthesizing data using deep generative models might overcome two significant concerns regarding multimodal data utilization, including physiological data. Our approach can contribute to the prevailing combined big data from different modalities, such as physiological and questionnaire survey data, when solving management issues.https://www.mdpi.com/2076-3417/14/1/378questionnaire surveymarketing researchEEGdeep learninggenerative adversarial networks (GANs)
spellingShingle Shinya Watanuki
Yumiko Nomura
Yuki Kiyota
Minami Kubo
Kenji Fujimoto
Junko Okada
Katsue Edo
Applying a Method for Augmenting Data Mixed from Two Different Sources Using Deep Generative Neural Networks to Management Science
Applied Sciences
questionnaire survey
marketing research
EEG
deep learning
generative adversarial networks (GANs)
title Applying a Method for Augmenting Data Mixed from Two Different Sources Using Deep Generative Neural Networks to Management Science
title_full Applying a Method for Augmenting Data Mixed from Two Different Sources Using Deep Generative Neural Networks to Management Science
title_fullStr Applying a Method for Augmenting Data Mixed from Two Different Sources Using Deep Generative Neural Networks to Management Science
title_full_unstemmed Applying a Method for Augmenting Data Mixed from Two Different Sources Using Deep Generative Neural Networks to Management Science
title_short Applying a Method for Augmenting Data Mixed from Two Different Sources Using Deep Generative Neural Networks to Management Science
title_sort applying a method for augmenting data mixed from two different sources using deep generative neural networks to management science
topic questionnaire survey
marketing research
EEG
deep learning
generative adversarial networks (GANs)
url https://www.mdpi.com/2076-3417/14/1/378
work_keys_str_mv AT shinyawatanuki applyingamethodforaugmentingdatamixedfromtwodifferentsourcesusingdeepgenerativeneuralnetworkstomanagementscience
AT yumikonomura applyingamethodforaugmentingdatamixedfromtwodifferentsourcesusingdeepgenerativeneuralnetworkstomanagementscience
AT yukikiyota applyingamethodforaugmentingdatamixedfromtwodifferentsourcesusingdeepgenerativeneuralnetworkstomanagementscience
AT minamikubo applyingamethodforaugmentingdatamixedfromtwodifferentsourcesusingdeepgenerativeneuralnetworkstomanagementscience
AT kenjifujimoto applyingamethodforaugmentingdatamixedfromtwodifferentsourcesusingdeepgenerativeneuralnetworkstomanagementscience
AT junkookada applyingamethodforaugmentingdatamixedfromtwodifferentsourcesusingdeepgenerativeneuralnetworkstomanagementscience
AT katsueedo applyingamethodforaugmentingdatamixedfromtwodifferentsourcesusingdeepgenerativeneuralnetworkstomanagementscience