A novel tool to track and analyze qualitative usability data: Lessons learned from the VA's personal health record

Scott A. Russell, Jason J. Saleem, David A. Haggstrom, Alissa L. Russ, Neale R. Chumbler

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

We developed a User-Testing Database to be able to process a greater amount of user data, from multiple sources of data, at a much finer level of granularity, and to be able to aid in a more sophisticated analysis, including specific queries of usability data than a typical "manual"-based usability analysis. In this paper, we demonstrate our User-Testing Database as applied to a usability assessment of the Veterans Affairs (VA) My HealtheVet personal health record. The usability test included 24 Veterans who completed a series of scenarios in the usability lab at a Midwest Veterans Affairs Medical Center (VAMC). The User-Testing Database facilitated reduction of data gathered from video review, facilitator notes, and debrief notes into 1160 observations that were sorted into conceptual bins and summarized for the designers of the personal health record. From creation of the database to completion of the reports took four months and did not require extensive knowledge of qualitative analysis techniques. We argue a User-Testing Database can allow other usability studies to increase the number of participants and the granularity of the data without prohibitively increasing the amount of time and experience required to process the data gathered.

Original languageEnglish (US)
Title of host publication54th Human Factors and Ergonomics Society Annual Meeting 2010, HFES 2010
Pages1264-1268
Number of pages5
DOIs
StatePublished - Dec 1 2010
Event54th Human Factors and Ergonomics Society Annual Meeting 2010, HFES 2010 - San Francisco, CA, United States
Duration: Sep 27 2010Oct 1 2010

Publication series

NameProceedings of the Human Factors and Ergonomics Society
Volume2
ISSN (Print)1071-1813

Other

Other54th Human Factors and Ergonomics Society Annual Meeting 2010, HFES 2010
CountryUnited States
CitySan Francisco, CA
Period9/27/1010/1/10

ASJC Scopus subject areas

  • Human Factors and Ergonomics

Fingerprint Dive into the research topics of 'A novel tool to track and analyze qualitative usability data: Lessons learned from the VA's personal health record'. Together they form a unique fingerprint.

  • Cite this

    Russell, S. A., Saleem, J. J., Haggstrom, D. A., Russ, A. L., & Chumbler, N. R. (2010). A novel tool to track and analyze qualitative usability data: Lessons learned from the VA's personal health record. In 54th Human Factors and Ergonomics Society Annual Meeting 2010, HFES 2010 (pp. 1264-1268). (Proceedings of the Human Factors and Ergonomics Society; Vol. 2). https://doi.org/10.1518/107118110X12829369835040