A novel tool to track and analyze qualitative usability data: Lessons learned from the VA's personal health record

Scott A. Russell, Jason J. Saleem, David Haggstrom, Alissa L. Russ, Neale R. Chumbler

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We developed a User-Testing Database to be able to process a greater amount of user data, from multiple sources of data, at a much finer level of granularity, and to be able to aid in a more sophisticated analysis, including specific queries of usability data than a typical "manual"-based usability analysis. In this paper, we demonstrate our User-Testing Database as applied to a usability assessment of the Veterans Affairs (VA) My HealtheVet personal health record. The usability test included 24 Veterans who completed a series of scenarios in the usability lab at a Midwest Veterans Affairs Medical Center (VAMC). The User-Testing Database facilitated reduction of data gathered from video review, facilitator notes, and debrief notes into 1160 observations that were sorted into conceptual bins and summarized for the designers of the personal health record. From creation of the database to completion of the reports took four months and did not require extensive knowledge of qualitative analysis techniques. We argue a User-Testing Database can allow other usability studies to increase the number of participants and the granularity of the data without prohibitively increasing the amount of time and experience required to process the data gathered.

Original languageEnglish
Title of host publicationProceedings of the Human Factors and Ergonomics Society
Pages1264-1268
Number of pages5
Volume2
DOIs
StatePublished - 2010
Event54th Human Factors and Ergonomics Society Annual Meeting 2010, HFES 2010 - San Francisco, CA, United States
Duration: Sep 27 2010Oct 1 2010

Other

Other54th Human Factors and Ergonomics Society Annual Meeting 2010, HFES 2010
CountryUnited States
CitySan Francisco, CA
Period9/27/1010/1/10

Fingerprint

Health
health
Testing
Bins
video
scenario
experience

ASJC Scopus subject areas

  • Human Factors and Ergonomics

Cite this

Russell, S. A., Saleem, J. J., Haggstrom, D., Russ, A. L., & Chumbler, N. R. (2010). A novel tool to track and analyze qualitative usability data: Lessons learned from the VA's personal health record. In Proceedings of the Human Factors and Ergonomics Society (Vol. 2, pp. 1264-1268) https://doi.org/10.1518/107118110X12829369835040

A novel tool to track and analyze qualitative usability data : Lessons learned from the VA's personal health record. / Russell, Scott A.; Saleem, Jason J.; Haggstrom, David; Russ, Alissa L.; Chumbler, Neale R.

Proceedings of the Human Factors and Ergonomics Society. Vol. 2 2010. p. 1264-1268.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Russell, SA, Saleem, JJ, Haggstrom, D, Russ, AL & Chumbler, NR 2010, A novel tool to track and analyze qualitative usability data: Lessons learned from the VA's personal health record. in Proceedings of the Human Factors and Ergonomics Society. vol. 2, pp. 1264-1268, 54th Human Factors and Ergonomics Society Annual Meeting 2010, HFES 2010, San Francisco, CA, United States, 9/27/10. https://doi.org/10.1518/107118110X12829369835040
Russell SA, Saleem JJ, Haggstrom D, Russ AL, Chumbler NR. A novel tool to track and analyze qualitative usability data: Lessons learned from the VA's personal health record. In Proceedings of the Human Factors and Ergonomics Society. Vol. 2. 2010. p. 1264-1268 https://doi.org/10.1518/107118110X12829369835040
Russell, Scott A. ; Saleem, Jason J. ; Haggstrom, David ; Russ, Alissa L. ; Chumbler, Neale R. / A novel tool to track and analyze qualitative usability data : Lessons learned from the VA's personal health record. Proceedings of the Human Factors and Ergonomics Society. Vol. 2 2010. pp. 1264-1268
@inproceedings{010f72e881f44b0a9ec8c63fb3b213ac,
title = "A novel tool to track and analyze qualitative usability data: Lessons learned from the VA's personal health record",
abstract = "We developed a User-Testing Database to be able to process a greater amount of user data, from multiple sources of data, at a much finer level of granularity, and to be able to aid in a more sophisticated analysis, including specific queries of usability data than a typical {"}manual{"}-based usability analysis. In this paper, we demonstrate our User-Testing Database as applied to a usability assessment of the Veterans Affairs (VA) My HealtheVet personal health record. The usability test included 24 Veterans who completed a series of scenarios in the usability lab at a Midwest Veterans Affairs Medical Center (VAMC). The User-Testing Database facilitated reduction of data gathered from video review, facilitator notes, and debrief notes into 1160 observations that were sorted into conceptual bins and summarized for the designers of the personal health record. From creation of the database to completion of the reports took four months and did not require extensive knowledge of qualitative analysis techniques. We argue a User-Testing Database can allow other usability studies to increase the number of participants and the granularity of the data without prohibitively increasing the amount of time and experience required to process the data gathered.",
author = "Russell, {Scott A.} and Saleem, {Jason J.} and David Haggstrom and Russ, {Alissa L.} and Chumbler, {Neale R.}",
year = "2010",
doi = "10.1518/107118110X12829369835040",
language = "English",
isbn = "9781617820885",
volume = "2",
pages = "1264--1268",
booktitle = "Proceedings of the Human Factors and Ergonomics Society",

}

TY - GEN

T1 - A novel tool to track and analyze qualitative usability data

T2 - Lessons learned from the VA's personal health record

AU - Russell, Scott A.

AU - Saleem, Jason J.

AU - Haggstrom, David

AU - Russ, Alissa L.

AU - Chumbler, Neale R.

PY - 2010

Y1 - 2010

N2 - We developed a User-Testing Database to be able to process a greater amount of user data, from multiple sources of data, at a much finer level of granularity, and to be able to aid in a more sophisticated analysis, including specific queries of usability data than a typical "manual"-based usability analysis. In this paper, we demonstrate our User-Testing Database as applied to a usability assessment of the Veterans Affairs (VA) My HealtheVet personal health record. The usability test included 24 Veterans who completed a series of scenarios in the usability lab at a Midwest Veterans Affairs Medical Center (VAMC). The User-Testing Database facilitated reduction of data gathered from video review, facilitator notes, and debrief notes into 1160 observations that were sorted into conceptual bins and summarized for the designers of the personal health record. From creation of the database to completion of the reports took four months and did not require extensive knowledge of qualitative analysis techniques. We argue a User-Testing Database can allow other usability studies to increase the number of participants and the granularity of the data without prohibitively increasing the amount of time and experience required to process the data gathered.

AB - We developed a User-Testing Database to be able to process a greater amount of user data, from multiple sources of data, at a much finer level of granularity, and to be able to aid in a more sophisticated analysis, including specific queries of usability data than a typical "manual"-based usability analysis. In this paper, we demonstrate our User-Testing Database as applied to a usability assessment of the Veterans Affairs (VA) My HealtheVet personal health record. The usability test included 24 Veterans who completed a series of scenarios in the usability lab at a Midwest Veterans Affairs Medical Center (VAMC). The User-Testing Database facilitated reduction of data gathered from video review, facilitator notes, and debrief notes into 1160 observations that were sorted into conceptual bins and summarized for the designers of the personal health record. From creation of the database to completion of the reports took four months and did not require extensive knowledge of qualitative analysis techniques. We argue a User-Testing Database can allow other usability studies to increase the number of participants and the granularity of the data without prohibitively increasing the amount of time and experience required to process the data gathered.

UR - http://www.scopus.com/inward/record.url?scp=79952964511&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79952964511&partnerID=8YFLogxK

U2 - 10.1518/107118110X12829369835040

DO - 10.1518/107118110X12829369835040

M3 - Conference contribution

AN - SCOPUS:79952964511

SN - 9781617820885

VL - 2

SP - 1264

EP - 1268

BT - Proceedings of the Human Factors and Ergonomics Society

ER -