A novel NIH research grant recommender using BERT.
Research grants are important for researchers to sustain a good position in academia. There are many grant opportunities available from different funding agencies. However, finding relevant grant announcements is challenging and time-consuming for researchers. To resolve the problem, we proposed a g...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2023-01-01
|
Series: | PLoS ONE |
Online Access: | https://doi.org/10.1371/journal.pone.0278636 |
_version_ | 1797944037839208448 |
---|---|
author | Jie Zhu Braja Gopal Patra Hulin Wu Ashraf Yaseen |
author_facet | Jie Zhu Braja Gopal Patra Hulin Wu Ashraf Yaseen |
author_sort | Jie Zhu |
collection | DOAJ |
description | Research grants are important for researchers to sustain a good position in academia. There are many grant opportunities available from different funding agencies. However, finding relevant grant announcements is challenging and time-consuming for researchers. To resolve the problem, we proposed a grant announcements recommendation system for the National Institute of Health (NIH) grants using researchers' publications. We formulated the recommendation as a classification problem and proposed a recommender using state-of-the-art deep learning techniques: i.e. Bidirectional Encoder Representations from Transformers (BERT), to capture intrinsic, non-linear relationship between researchers' publications and grants announcements. Internal and external evaluations were conducted to assess the system's usefulness. During internal evaluations, the grant citations were used to establish grant-publication ground truth, and results were evaluated against Recall@k, Precision@k, Mean reciprocal rank (MRR) and Area under the Receiver Operating Characteristic curve (ROC-AUC). During external evaluations, researchers' publications were clustered using Dirichlet Process Mixture Model (DPMM), recommended grants by our model were then aggregated per cluster through Recency Weight, and finally researchers were invited to provide ratings to recommendations to calculate Precision@k. For comparison, baseline recommenders using Okapi Best Matching (BM25), Term-Frequency Inverse Document Frequency (TF-IDF), doc2vec, and Naïve Bayes (NB) were also developed. Both internal and external evaluations (all metrics) revealed favorable performances of our proposed BERT-based recommender. |
first_indexed | 2024-04-10T20:32:21Z |
format | Article |
id | doaj.art-f6e1fe42f07e4e8cb6b41e3ed3c1b271 |
institution | Directory Open Access Journal |
issn | 1932-6203 |
language | English |
last_indexed | 2024-04-10T20:32:21Z |
publishDate | 2023-01-01 |
publisher | Public Library of Science (PLoS) |
record_format | Article |
series | PLoS ONE |
spelling | doaj.art-f6e1fe42f07e4e8cb6b41e3ed3c1b2712023-01-25T05:33:11ZengPublic Library of Science (PLoS)PLoS ONE1932-62032023-01-01181e027863610.1371/journal.pone.0278636A novel NIH research grant recommender using BERT.Jie ZhuBraja Gopal PatraHulin WuAshraf YaseenResearch grants are important for researchers to sustain a good position in academia. There are many grant opportunities available from different funding agencies. However, finding relevant grant announcements is challenging and time-consuming for researchers. To resolve the problem, we proposed a grant announcements recommendation system for the National Institute of Health (NIH) grants using researchers' publications. We formulated the recommendation as a classification problem and proposed a recommender using state-of-the-art deep learning techniques: i.e. Bidirectional Encoder Representations from Transformers (BERT), to capture intrinsic, non-linear relationship between researchers' publications and grants announcements. Internal and external evaluations were conducted to assess the system's usefulness. During internal evaluations, the grant citations were used to establish grant-publication ground truth, and results were evaluated against Recall@k, Precision@k, Mean reciprocal rank (MRR) and Area under the Receiver Operating Characteristic curve (ROC-AUC). During external evaluations, researchers' publications were clustered using Dirichlet Process Mixture Model (DPMM), recommended grants by our model were then aggregated per cluster through Recency Weight, and finally researchers were invited to provide ratings to recommendations to calculate Precision@k. For comparison, baseline recommenders using Okapi Best Matching (BM25), Term-Frequency Inverse Document Frequency (TF-IDF), doc2vec, and Naïve Bayes (NB) were also developed. Both internal and external evaluations (all metrics) revealed favorable performances of our proposed BERT-based recommender.https://doi.org/10.1371/journal.pone.0278636 |
spellingShingle | Jie Zhu Braja Gopal Patra Hulin Wu Ashraf Yaseen A novel NIH research grant recommender using BERT. PLoS ONE |
title | A novel NIH research grant recommender using BERT. |
title_full | A novel NIH research grant recommender using BERT. |
title_fullStr | A novel NIH research grant recommender using BERT. |
title_full_unstemmed | A novel NIH research grant recommender using BERT. |
title_short | A novel NIH research grant recommender using BERT. |
title_sort | novel nih research grant recommender using bert |
url | https://doi.org/10.1371/journal.pone.0278636 |
work_keys_str_mv | AT jiezhu anovelnihresearchgrantrecommenderusingbert AT brajagopalpatra anovelnihresearchgrantrecommenderusingbert AT hulinwu anovelnihresearchgrantrecommenderusingbert AT ashrafyaseen anovelnihresearchgrantrecommenderusingbert AT jiezhu novelnihresearchgrantrecommenderusingbert AT brajagopalpatra novelnihresearchgrantrecommenderusingbert AT hulinwu novelnihresearchgrantrecommenderusingbert AT ashrafyaseen novelnihresearchgrantrecommenderusingbert |