Reliability and Validity Issues Related to Interactive Tailored Patient Assessments: A Case Study

Recently there has been a proliferation of interactive tailored patient assessment (ITPA) tools. However, evidence of the reliability and validity of these instruments is often missing, which makes their value in research studies questionable. Because several of the common methods to evaluate instru...

Full description

Bibliographic Details
Main Authors: Ruland, Cornelia M, Bakken, Suzanne, Røislien, Jo
Format: Article
Language:English
Published: JMIR Publications 2007-08-01
Series:Journal of Medical Internet Research
Online Access:http://www.jmir.org/2007/3/e22/
Description
Summary:Recently there has been a proliferation of interactive tailored patient assessment (ITPA) tools. However, evidence of the reliability and validity of these instruments is often missing, which makes their value in research studies questionable. Because several of the common methods to evaluate instrument reliability and validity are not applicable to interactive tailored patient assessments, informatics researchers may benefit from some guidance on which methods of reliability and validity assessment they can appropriately use. This paper describes the main differences between interactive tailored patient assessments and assessment instruments based on psychometric, or classical test, theory; it summarizes the measurement techniques normally used to ascertain the validity and reliability of assessment instruments based on psychometric theory; it discusses which methods are appropriate for interactive tailored patient assessments and which are not; and finally, it illustrates the application of some of the feasible techniques with a case study that describes how the reliability and validity of the tailored symptom assessment instrument called Choice were evaluated.
ISSN:1438-8871