Global Relation Reasoning Graph Convolutional Networks for Human Pose Estimation
We explore the importance of global relation reasoning in Human Pose Estimation (HPE). Global relation reasoning aims to globally learn relations among regions of images or videos. For HPE, if we can globally model the relations among different body joints, we may mitigate some challenges such as oc...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8990101/ |
| _version_ | 1818856963500408832 |
|---|---|
| author | Rui Wang Chenyang Huang Xiangyang Wang |
| author_facet | Rui Wang Chenyang Huang Xiangyang Wang |
| author_sort | Rui Wang |
| collection | DOAJ |
| description | We explore the importance of global relation reasoning in Human Pose Estimation (HPE). Global relation reasoning aims to globally learn relations among regions of images or videos. For HPE, if we can globally model the relations among different body joints, we may mitigate some challenges such as occlusion. Most existing human pose estimation methods rely on building Convolutional Neural Networks (CNNs). Because convolution operations can only model local relations, in order to capture global relations, they must inefficiently stack multiple convolution layers to enlarge the receptive fields to cover all the body joints in the image. In this paper, we propose to utilize Global Relation Reasoning Graph Convolutional Networks (GRR-GCN) to efficiently capture the global relations among different body joints. GRR-GCN projects all the features in the original coordinate space to a graph space. In the graph space, these features are represented by a set of nodes to form a fully-connected graph, on which global relation reasoning is performed by graph convolution. After reasoning, node features are projected back to the coordinate space for further processing. GRR-GCN is a plug-and-play module, and can be integrated into current state-of-the-art networks. Experiments on human pose estimation benchmark, MPII and COCO keypoint detection dataset, show that GRR-GCN can boost the performance of state-of-the-art human pose estimation networks including SimpleBaseline and HRNet (High-Resolution Net). |
| first_indexed | 2024-12-19T08:32:51Z |
| format | Article |
| id | doaj.art-95d4a17a82c54f4584aec8e014e21f8c |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-19T08:32:51Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-95d4a17a82c54f4584aec8e014e21f8c2022-12-21T20:29:07ZengIEEEIEEE Access2169-35362020-01-018384723848010.1109/ACCESS.2020.29730398990101Global Relation Reasoning Graph Convolutional Networks for Human Pose EstimationRui Wang0https://orcid.org/0000-0002-7974-9510Chenyang Huang1Xiangyang Wang2Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, School of Communication and Information Engineering, Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, ChinaKey Laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, School of Communication and Information Engineering, Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, ChinaKey Laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, School of Communication and Information Engineering, Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, ChinaWe explore the importance of global relation reasoning in Human Pose Estimation (HPE). Global relation reasoning aims to globally learn relations among regions of images or videos. For HPE, if we can globally model the relations among different body joints, we may mitigate some challenges such as occlusion. Most existing human pose estimation methods rely on building Convolutional Neural Networks (CNNs). Because convolution operations can only model local relations, in order to capture global relations, they must inefficiently stack multiple convolution layers to enlarge the receptive fields to cover all the body joints in the image. In this paper, we propose to utilize Global Relation Reasoning Graph Convolutional Networks (GRR-GCN) to efficiently capture the global relations among different body joints. GRR-GCN projects all the features in the original coordinate space to a graph space. In the graph space, these features are represented by a set of nodes to form a fully-connected graph, on which global relation reasoning is performed by graph convolution. After reasoning, node features are projected back to the coordinate space for further processing. GRR-GCN is a plug-and-play module, and can be integrated into current state-of-the-art networks. Experiments on human pose estimation benchmark, MPII and COCO keypoint detection dataset, show that GRR-GCN can boost the performance of state-of-the-art human pose estimation networks including SimpleBaseline and HRNet (High-Resolution Net).https://ieeexplore.ieee.org/document/8990101/Human pose estimationgraph convolutional networks (GCN)global relation reasoning |
| spellingShingle | Rui Wang Chenyang Huang Xiangyang Wang Global Relation Reasoning Graph Convolutional Networks for Human Pose Estimation IEEE Access Human pose estimation graph convolutional networks (GCN) global relation reasoning |
| title | Global Relation Reasoning Graph Convolutional Networks for Human Pose Estimation |
| title_full | Global Relation Reasoning Graph Convolutional Networks for Human Pose Estimation |
| title_fullStr | Global Relation Reasoning Graph Convolutional Networks for Human Pose Estimation |
| title_full_unstemmed | Global Relation Reasoning Graph Convolutional Networks for Human Pose Estimation |
| title_short | Global Relation Reasoning Graph Convolutional Networks for Human Pose Estimation |
| title_sort | global relation reasoning graph convolutional networks for human pose estimation |
| topic | Human pose estimation graph convolutional networks (GCN) global relation reasoning |
| url | https://ieeexplore.ieee.org/document/8990101/ |
| work_keys_str_mv | AT ruiwang globalrelationreasoninggraphconvolutionalnetworksforhumanposeestimation AT chenyanghuang globalrelationreasoninggraphconvolutionalnetworksforhumanposeestimation AT xiangyangwang globalrelationreasoninggraphconvolutionalnetworksforhumanposeestimation |