Study on Data Filling Based on Global-attributes Attention Neural Process Model

The attention neural process(ANP) model which adopts the method of generative model,takes any number context points of the sample as input,and outputs the distribution function of the entire sample,so as to approximate the function of Gaussian process regression(GPR) to realize the data fullfilling...

Full description

Bibliographic Details
Main Author: CHEN Kai, LIU Man, WANG Zhi-teng, MAO Shao-chen, SHEN Qiu-hui, ZHANG Hong-jun
Format: Article
Language:zho
Published: Editorial office of Computer Science 2022-10-01
Series:Jisuanji kexue
Subjects:
Online Access:https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-49-10-111.pdf
_version_ 1797845156192321536
author CHEN Kai, LIU Man, WANG Zhi-teng, MAO Shao-chen, SHEN Qiu-hui, ZHANG Hong-jun
author_facet CHEN Kai, LIU Man, WANG Zhi-teng, MAO Shao-chen, SHEN Qiu-hui, ZHANG Hong-jun
author_sort CHEN Kai, LIU Man, WANG Zhi-teng, MAO Shao-chen, SHEN Qiu-hui, ZHANG Hong-jun
collection DOAJ
description The attention neural process(ANP) model which adopts the method of generative model,takes any number context points of the sample as input,and outputs the distribution function of the entire sample,so as to approximate the function of Gaussian process regression(GPR) to realize the data fullfilling task.In reality,many scenes or datasets containe the attributes or labels data which are critical for generating the missing data.However,the ANP ignores full use of them.Inspired by CVAE model which control sample generation with lable as condition,this paper proposes global attribute attentional neural process(GANP),which embeds sample attributes or labels into ANP network to make the model generate samples more accurately,especially when the number of input context points are scarce.In detail,the sample attributes are embedded into the encoder network,so that the latent variables contain the sample attribute information.At the same time,the sample attributes are added as features in the decoder network to help generate more accurate samples.Finally,experimental results prove the superiority of GANP in both qualitative and quantitative,and it also reveals that GANP expands the application of NP families which can solve the Gaus-sian process regression problem more flexibly,quickly and accurately.
first_indexed 2024-04-09T17:34:00Z
format Article
id doaj.art-c466e55ee90e499b83001c100f179f68
institution Directory Open Access Journal
issn 1002-137X
language zho
last_indexed 2024-04-09T17:34:00Z
publishDate 2022-10-01
publisher Editorial office of Computer Science
record_format Article
series Jisuanji kexue
spelling doaj.art-c466e55ee90e499b83001c100f179f682023-04-18T02:32:39ZzhoEditorial office of Computer ScienceJisuanji kexue1002-137X2022-10-01491011111710.11896/jsjkx.210800038Study on Data Filling Based on Global-attributes Attention Neural Process ModelCHEN Kai, LIU Man, WANG Zhi-teng, MAO Shao-chen, SHEN Qiu-hui, ZHANG Hong-jun01 Institute of Command and Control Engineering,Army Engineering University of PLA,Nanjing 210007,China ;2 73131 Unit of PLA,Zhangzhou,Fujian 363000,ChinaThe attention neural process(ANP) model which adopts the method of generative model,takes any number context points of the sample as input,and outputs the distribution function of the entire sample,so as to approximate the function of Gaussian process regression(GPR) to realize the data fullfilling task.In reality,many scenes or datasets containe the attributes or labels data which are critical for generating the missing data.However,the ANP ignores full use of them.Inspired by CVAE model which control sample generation with lable as condition,this paper proposes global attribute attentional neural process(GANP),which embeds sample attributes or labels into ANP network to make the model generate samples more accurately,especially when the number of input context points are scarce.In detail,the sample attributes are embedded into the encoder network,so that the latent variables contain the sample attribute information.At the same time,the sample attributes are added as features in the decoder network to help generate more accurate samples.Finally,experimental results prove the superiority of GANP in both qualitative and quantitative,and it also reveals that GANP expands the application of NP families which can solve the Gaus-sian process regression problem more flexibly,quickly and accurately.https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-49-10-111.pdfneural process|cross attention|variational inference|gaussian process|global attribute
spellingShingle CHEN Kai, LIU Man, WANG Zhi-teng, MAO Shao-chen, SHEN Qiu-hui, ZHANG Hong-jun
Study on Data Filling Based on Global-attributes Attention Neural Process Model
Jisuanji kexue
neural process|cross attention|variational inference|gaussian process|global attribute
title Study on Data Filling Based on Global-attributes Attention Neural Process Model
title_full Study on Data Filling Based on Global-attributes Attention Neural Process Model
title_fullStr Study on Data Filling Based on Global-attributes Attention Neural Process Model
title_full_unstemmed Study on Data Filling Based on Global-attributes Attention Neural Process Model
title_short Study on Data Filling Based on Global-attributes Attention Neural Process Model
title_sort study on data filling based on global attributes attention neural process model
topic neural process|cross attention|variational inference|gaussian process|global attribute
url https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-49-10-111.pdf
work_keys_str_mv AT chenkailiumanwangzhitengmaoshaochenshenqiuhuizhanghongjun studyondatafillingbasedonglobalattributesattentionneuralprocessmodel