Context-sensitive ecological momentary assessment

Application of user-centered design for improving user satisfaction and engagement during self-report

Preethi Srinivas, Kunal Bodke, Susan Ofner, Ni Cole R. Keith, Wanzhu Tu, Daniel Clark

Research output: Contribution to journalArticle

Abstract

Background: Ecological momentary assessment (EMA) can be a useful tool for collecting real-time behavioral data in studies of health and health behavior. However, EMA administered through mobile technology can be burdensome, and it tends to suffer from suboptimal user engagement, particularly in low health-literacy populations. Objective: This study aimed to report a case study involving the design and evaluation of a mobile EMA tool that supports context-sensitive EMA-reporting of location and social situations accompanying eating and sedentary behavior. Methods: An iterative, user-centered design process with obese, middle-aged women seeking care in a safety-net health system was used to identify the preferred format of self-report measures and the look, feel, and interaction of the mobile EMA tool. A single-arm feasibility field trial with 21 participants receiving 12 prompts each day for momentary self-reports over a 4-week period (336 total prompts per participant) was used to determine user satisfaction with interface quality and user engagement, operationalized as response rate. A second trial among 38 different participants randomized to receive or not to receive a feature designed to improve engagement was conducted. Results: The feasibility trial results showed high interface satisfaction and engagement, with an average response rate of 50% over 4 weeks. Qualitative feedback pointed to the need for auditory alerts. We settled on 3 alerts at 10-min intervals to accompany each EMA-reporting prompt. The second trial testing this feature showed a statistically significant increase in the response rate between participants randomized to receive repeat auditory alerts versus those who were not (60% vs 40%). Conclusions: This paper reviews the design research and a set of design constraints that may be considered in the creation of mobile EMA interfaces personalized to users' preferences. Novel aspects of the study include the involvement of low health-literacy adults in design research, the capture of data on time, place, and social context of eating and sedentary behavior, and reporting prompts tailored to an individual's location and schedule.

Original languageEnglish (US)
Article numbere10894
JournalJournal of medical Internet research
Volume21
Issue number4
DOIs
StatePublished - Apr 1 2019

Fingerprint

Self Report
Health Literacy
Feeding Behavior
Research Design
Health Behavior
Health
Ecological Momentary Assessment
Appointments and Schedules
Technology
Safety
Population

Keywords

  • Ecological momentary assessment
  • Health status
  • Mhealth
  • Obesity

ASJC Scopus subject areas

  • Health Informatics

Cite this

Context-sensitive ecological momentary assessment : Application of user-centered design for improving user satisfaction and engagement during self-report. / Srinivas, Preethi; Bodke, Kunal; Ofner, Susan; Keith, Ni Cole R.; Tu, Wanzhu; Clark, Daniel.

In: Journal of medical Internet research, Vol. 21, No. 4, e10894, 01.04.2019.

Research output: Contribution to journalArticle

@article{eee0bbe59ef54c1ea484ace9788c6438,
title = "Context-sensitive ecological momentary assessment: Application of user-centered design for improving user satisfaction and engagement during self-report",
abstract = "Background: Ecological momentary assessment (EMA) can be a useful tool for collecting real-time behavioral data in studies of health and health behavior. However, EMA administered through mobile technology can be burdensome, and it tends to suffer from suboptimal user engagement, particularly in low health-literacy populations. Objective: This study aimed to report a case study involving the design and evaluation of a mobile EMA tool that supports context-sensitive EMA-reporting of location and social situations accompanying eating and sedentary behavior. Methods: An iterative, user-centered design process with obese, middle-aged women seeking care in a safety-net health system was used to identify the preferred format of self-report measures and the look, feel, and interaction of the mobile EMA tool. A single-arm feasibility field trial with 21 participants receiving 12 prompts each day for momentary self-reports over a 4-week period (336 total prompts per participant) was used to determine user satisfaction with interface quality and user engagement, operationalized as response rate. A second trial among 38 different participants randomized to receive or not to receive a feature designed to improve engagement was conducted. Results: The feasibility trial results showed high interface satisfaction and engagement, with an average response rate of 50{\%} over 4 weeks. Qualitative feedback pointed to the need for auditory alerts. We settled on 3 alerts at 10-min intervals to accompany each EMA-reporting prompt. The second trial testing this feature showed a statistically significant increase in the response rate between participants randomized to receive repeat auditory alerts versus those who were not (60{\%} vs 40{\%}). Conclusions: This paper reviews the design research and a set of design constraints that may be considered in the creation of mobile EMA interfaces personalized to users' preferences. Novel aspects of the study include the involvement of low health-literacy adults in design research, the capture of data on time, place, and social context of eating and sedentary behavior, and reporting prompts tailored to an individual's location and schedule.",
keywords = "Ecological momentary assessment, Health status, Mhealth, Obesity",
author = "Preethi Srinivas and Kunal Bodke and Susan Ofner and Keith, {Ni Cole R.} and Wanzhu Tu and Daniel Clark",
year = "2019",
month = "4",
day = "1",
doi = "10.2196/10894",
language = "English (US)",
volume = "21",
journal = "Journal of Medical Internet Research",
issn = "1439-4456",
publisher = "Journal of medical Internet Research",
number = "4",

}

TY - JOUR

T1 - Context-sensitive ecological momentary assessment

T2 - Application of user-centered design for improving user satisfaction and engagement during self-report

AU - Srinivas, Preethi

AU - Bodke, Kunal

AU - Ofner, Susan

AU - Keith, Ni Cole R.

AU - Tu, Wanzhu

AU - Clark, Daniel

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Background: Ecological momentary assessment (EMA) can be a useful tool for collecting real-time behavioral data in studies of health and health behavior. However, EMA administered through mobile technology can be burdensome, and it tends to suffer from suboptimal user engagement, particularly in low health-literacy populations. Objective: This study aimed to report a case study involving the design and evaluation of a mobile EMA tool that supports context-sensitive EMA-reporting of location and social situations accompanying eating and sedentary behavior. Methods: An iterative, user-centered design process with obese, middle-aged women seeking care in a safety-net health system was used to identify the preferred format of self-report measures and the look, feel, and interaction of the mobile EMA tool. A single-arm feasibility field trial with 21 participants receiving 12 prompts each day for momentary self-reports over a 4-week period (336 total prompts per participant) was used to determine user satisfaction with interface quality and user engagement, operationalized as response rate. A second trial among 38 different participants randomized to receive or not to receive a feature designed to improve engagement was conducted. Results: The feasibility trial results showed high interface satisfaction and engagement, with an average response rate of 50% over 4 weeks. Qualitative feedback pointed to the need for auditory alerts. We settled on 3 alerts at 10-min intervals to accompany each EMA-reporting prompt. The second trial testing this feature showed a statistically significant increase in the response rate between participants randomized to receive repeat auditory alerts versus those who were not (60% vs 40%). Conclusions: This paper reviews the design research and a set of design constraints that may be considered in the creation of mobile EMA interfaces personalized to users' preferences. Novel aspects of the study include the involvement of low health-literacy adults in design research, the capture of data on time, place, and social context of eating and sedentary behavior, and reporting prompts tailored to an individual's location and schedule.

AB - Background: Ecological momentary assessment (EMA) can be a useful tool for collecting real-time behavioral data in studies of health and health behavior. However, EMA administered through mobile technology can be burdensome, and it tends to suffer from suboptimal user engagement, particularly in low health-literacy populations. Objective: This study aimed to report a case study involving the design and evaluation of a mobile EMA tool that supports context-sensitive EMA-reporting of location and social situations accompanying eating and sedentary behavior. Methods: An iterative, user-centered design process with obese, middle-aged women seeking care in a safety-net health system was used to identify the preferred format of self-report measures and the look, feel, and interaction of the mobile EMA tool. A single-arm feasibility field trial with 21 participants receiving 12 prompts each day for momentary self-reports over a 4-week period (336 total prompts per participant) was used to determine user satisfaction with interface quality and user engagement, operationalized as response rate. A second trial among 38 different participants randomized to receive or not to receive a feature designed to improve engagement was conducted. Results: The feasibility trial results showed high interface satisfaction and engagement, with an average response rate of 50% over 4 weeks. Qualitative feedback pointed to the need for auditory alerts. We settled on 3 alerts at 10-min intervals to accompany each EMA-reporting prompt. The second trial testing this feature showed a statistically significant increase in the response rate between participants randomized to receive repeat auditory alerts versus those who were not (60% vs 40%). Conclusions: This paper reviews the design research and a set of design constraints that may be considered in the creation of mobile EMA interfaces personalized to users' preferences. Novel aspects of the study include the involvement of low health-literacy adults in design research, the capture of data on time, place, and social context of eating and sedentary behavior, and reporting prompts tailored to an individual's location and schedule.

KW - Ecological momentary assessment

KW - Health status

KW - Mhealth

KW - Obesity

UR - http://www.scopus.com/inward/record.url?scp=85067306518&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067306518&partnerID=8YFLogxK

U2 - 10.2196/10894

DO - 10.2196/10894

M3 - Article

VL - 21

JO - Journal of Medical Internet Research

JF - Journal of Medical Internet Research

SN - 1439-4456

IS - 4

M1 - e10894

ER -