The Evaluation of Discovery: Models, Simulation and Search through “Big Data”

A central theme in western philosophy was to find formal methods that can reliably discover empirical relationships and their explanations from data assembled from experience. As a philosophical project, that ambition was abandoned in the 20th century and generally dismissed as impossible. It was re...

Full description

Bibliographic Details
Main Authors: Glymour Clark, Ramsey Joseph D., Zhang Kun
Format: Article
Language:English
Published: De Gruyter 2019-01-01
Series:Open Philosophy
Subjects:
Online Access:http://www.degruyter.com/view/j/opphil.2019.2.issue-1/opphil-2019-0005/opphil-2019-0005.xml?format=INT
_version_ 1818591532132859904
author Glymour Clark
Ramsey Joseph D.
Zhang Kun
author_facet Glymour Clark
Ramsey Joseph D.
Zhang Kun
author_sort Glymour Clark
collection DOAJ
description A central theme in western philosophy was to find formal methods that can reliably discover empirical relationships and their explanations from data assembled from experience. As a philosophical project, that ambition was abandoned in the 20th century and generally dismissed as impossible. It was replaced in philosophy by neo-Kantian efforts at reconstruction and justification, and in professional statistics by the more limited ambition to estimate a small number of parameters in pre-specified hypotheses. The influx of “big data” from climate science, neuropsychology, biology, astronomy and elsewhere implicitly called for a revival of the grander philosophical ambition. Search algorithms are meeting that call, but they pose a problem: how are their accuracies to be assessed in domains where experimentation is limited or impossible? Increasingly, the answer is through simulation of data from models of the kind of process in the domain. In some cases, these innovations require rethinking how the accuracy and informativeness of inference methods can be assessed. Focusing on causal inference, we give an example from neuroscience, but to show that the model/simulation strategy is not confined to causal inference, we also consider two classification problems from astrophysics: identifying exoplanets and identifying dark matter concentrations.
first_indexed 2024-12-16T10:13:56Z
format Article
id doaj.art-abbc06f80162461cbaeee58b6d254afc
institution Directory Open Access Journal
issn 2543-8875
language English
last_indexed 2024-12-16T10:13:56Z
publishDate 2019-01-01
publisher De Gruyter
record_format Article
series Open Philosophy
spelling doaj.art-abbc06f80162461cbaeee58b6d254afc2022-12-21T22:35:31ZengDe GruyterOpen Philosophy2543-88752019-01-0121394810.1515/opphil-2019-0005opphil-2019-0005The Evaluation of Discovery: Models, Simulation and Search through “Big Data”Glymour Clark0Ramsey Joseph D.1Zhang Kun2Clark Glymour, Carnegie MellonUniversity, United States of AmericaCarnegie MellonUniversity, United States of AmericaCarnegie MellonUniversity, United States of AmericaA central theme in western philosophy was to find formal methods that can reliably discover empirical relationships and their explanations from data assembled from experience. As a philosophical project, that ambition was abandoned in the 20th century and generally dismissed as impossible. It was replaced in philosophy by neo-Kantian efforts at reconstruction and justification, and in professional statistics by the more limited ambition to estimate a small number of parameters in pre-specified hypotheses. The influx of “big data” from climate science, neuropsychology, biology, astronomy and elsewhere implicitly called for a revival of the grander philosophical ambition. Search algorithms are meeting that call, but they pose a problem: how are their accuracies to be assessed in domains where experimentation is limited or impossible? Increasingly, the answer is through simulation of data from models of the kind of process in the domain. In some cases, these innovations require rethinking how the accuracy and informativeness of inference methods can be assessed. Focusing on causal inference, we give an example from neuroscience, but to show that the model/simulation strategy is not confined to causal inference, we also consider two classification problems from astrophysics: identifying exoplanets and identifying dark matter concentrations.http://www.degruyter.com/view/j/opphil.2019.2.issue-1/opphil-2019-0005/opphil-2019-0005.xml?format=INTbig datacomputerized searchdiscoverysimulation
spellingShingle Glymour Clark
Ramsey Joseph D.
Zhang Kun
The Evaluation of Discovery: Models, Simulation and Search through “Big Data”
Open Philosophy
big data
computerized search
discovery
simulation
title The Evaluation of Discovery: Models, Simulation and Search through “Big Data”
title_full The Evaluation of Discovery: Models, Simulation and Search through “Big Data”
title_fullStr The Evaluation of Discovery: Models, Simulation and Search through “Big Data”
title_full_unstemmed The Evaluation of Discovery: Models, Simulation and Search through “Big Data”
title_short The Evaluation of Discovery: Models, Simulation and Search through “Big Data”
title_sort evaluation of discovery models simulation and search through big data
topic big data
computerized search
discovery
simulation
url http://www.degruyter.com/view/j/opphil.2019.2.issue-1/opphil-2019-0005/opphil-2019-0005.xml?format=INT
work_keys_str_mv AT glymourclark theevaluationofdiscoverymodelssimulationandsearchthroughbigdata
AT ramseyjosephd theevaluationofdiscoverymodelssimulationandsearchthroughbigdata
AT zhangkun theevaluationofdiscoverymodelssimulationandsearchthroughbigdata
AT glymourclark evaluationofdiscoverymodelssimulationandsearchthroughbigdata
AT ramseyjosephd evaluationofdiscoverymodelssimulationandsearchthroughbigdata
AT zhangkun evaluationofdiscoverymodelssimulationandsearchthroughbigdata