Phylogenetic and functional assessment of orthologs inference projects and methods.

Accurate genome-wide identification of orthologs is a central problem in comparative genomics, a fact reflected by the numerous orthology identification projects developed in recent years. However, only a few reports have compared their accuracy, and indeed, several recent efforts have not yet been...

Full description

Bibliographic Details
Main Authors: Adrian M Altenhoff, Christophe Dessimoz
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2009-01-01
Series:PLoS Computational Biology
Online Access:http://europepmc.org/articles/PMC2612752?pdf=render
_version_ 1811338077657890816
author Adrian M Altenhoff
Christophe Dessimoz
author_facet Adrian M Altenhoff
Christophe Dessimoz
author_sort Adrian M Altenhoff
collection DOAJ
description Accurate genome-wide identification of orthologs is a central problem in comparative genomics, a fact reflected by the numerous orthology identification projects developed in recent years. However, only a few reports have compared their accuracy, and indeed, several recent efforts have not yet been systematically evaluated. Furthermore, orthology is typically only assessed in terms of function conservation, despite the phylogeny-based original definition of Fitch. We collected and mapped the results of nine leading orthology projects and methods (COG, KOG, Inparanoid, OrthoMCL, Ensembl Compara, Homologene, RoundUp, EggNOG, and OMA) and two standard methods (bidirectional best-hit and reciprocal smallest distance). We systematically compared their predictions with respect to both phylogeny and function, using six different tests. This required the mapping of millions of sequences, the handling of hundreds of millions of predicted pairs of orthologs, and the computation of tens of thousands of trees. In phylogenetic analysis or in functional analysis where high specificity is required, we find that OMA and Homologene perform best. At lower functional specificity but higher coverage level, OrthoMCL outperforms Ensembl Compara, and to a lesser extent Inparanoid. Lastly, the large coverage of the recent EggNOG can be of interest to build broad functional grouping, but the method is not specific enough for phylogenetic or detailed function analyses. In terms of general methodology, we observe that the more sophisticated tree reconstruction/reconciliation approach of Ensembl Compara was at times outperformed by pairwise comparison approaches, even in phylogenetic tests. Furthermore, we show that standard bidirectional best-hit often outperforms projects with more complex algorithms. First, the present study provides guidance for the broad community of orthology data users as to which database best suits their needs. Second, it introduces new methodology to verify orthology. And third, it sets performance standards for current and future approaches.
first_indexed 2024-04-13T18:05:26Z
format Article
id doaj.art-6188e19be67a45909939d5dd84160afd
institution Directory Open Access Journal
issn 1553-734X
1553-7358
language English
last_indexed 2024-04-13T18:05:26Z
publishDate 2009-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS Computational Biology
spelling doaj.art-6188e19be67a45909939d5dd84160afd2022-12-22T02:36:05ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582009-01-0151e100026210.1371/journal.pcbi.1000262Phylogenetic and functional assessment of orthologs inference projects and methods.Adrian M AltenhoffChristophe DessimozAccurate genome-wide identification of orthologs is a central problem in comparative genomics, a fact reflected by the numerous orthology identification projects developed in recent years. However, only a few reports have compared their accuracy, and indeed, several recent efforts have not yet been systematically evaluated. Furthermore, orthology is typically only assessed in terms of function conservation, despite the phylogeny-based original definition of Fitch. We collected and mapped the results of nine leading orthology projects and methods (COG, KOG, Inparanoid, OrthoMCL, Ensembl Compara, Homologene, RoundUp, EggNOG, and OMA) and two standard methods (bidirectional best-hit and reciprocal smallest distance). We systematically compared their predictions with respect to both phylogeny and function, using six different tests. This required the mapping of millions of sequences, the handling of hundreds of millions of predicted pairs of orthologs, and the computation of tens of thousands of trees. In phylogenetic analysis or in functional analysis where high specificity is required, we find that OMA and Homologene perform best. At lower functional specificity but higher coverage level, OrthoMCL outperforms Ensembl Compara, and to a lesser extent Inparanoid. Lastly, the large coverage of the recent EggNOG can be of interest to build broad functional grouping, but the method is not specific enough for phylogenetic or detailed function analyses. In terms of general methodology, we observe that the more sophisticated tree reconstruction/reconciliation approach of Ensembl Compara was at times outperformed by pairwise comparison approaches, even in phylogenetic tests. Furthermore, we show that standard bidirectional best-hit often outperforms projects with more complex algorithms. First, the present study provides guidance for the broad community of orthology data users as to which database best suits their needs. Second, it introduces new methodology to verify orthology. And third, it sets performance standards for current and future approaches.http://europepmc.org/articles/PMC2612752?pdf=render
spellingShingle Adrian M Altenhoff
Christophe Dessimoz
Phylogenetic and functional assessment of orthologs inference projects and methods.
PLoS Computational Biology
title Phylogenetic and functional assessment of orthologs inference projects and methods.
title_full Phylogenetic and functional assessment of orthologs inference projects and methods.
title_fullStr Phylogenetic and functional assessment of orthologs inference projects and methods.
title_full_unstemmed Phylogenetic and functional assessment of orthologs inference projects and methods.
title_short Phylogenetic and functional assessment of orthologs inference projects and methods.
title_sort phylogenetic and functional assessment of orthologs inference projects and methods
url http://europepmc.org/articles/PMC2612752?pdf=render
work_keys_str_mv AT adrianmaltenhoff phylogeneticandfunctionalassessmentoforthologsinferenceprojectsandmethods
AT christophedessimoz phylogeneticandfunctionalassessmentoforthologsinferenceprojectsandmethods