Evaluating the Impact of a HIV Low-Risk Express Care Task-Shifting Program: A Case Study of the Targeted Learning Roadmap

Linh Tran, Constantin Yiannoutsos, Beverly S. Musick, Kara Wools-Kaloustian, Abraham Siika, Sylvester Kimaiyo, Mark J. Van Der Laan, Maya Petersen

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

In conducting studies on an exposure of interest, a systematic roadmap should be applied for translating causal questions into statistical analyses and interpreting the results. In this paper we describe an application of one such roadmap applied to estimating the joint effect of both time to availability of a nurse-based triage system (low risk express care (LREC)) and individual enrollment in the program among HIV patients in East Africa. Our study population is comprised of 16,513 subjects found eligible for this task-shifting program within 15 clinics in Kenya between 2006 and 2009, with each clinic starting the LREC program between 2007 and 2008. After discretizing follow-up into 90-day time intervals, we targeted the population mean counterfactual outcome (i. e. counterfactual probability of either dying or being lost to follow up) at up to 450 days after initial LREC eligibility under three fixed treatment interventions. These were (i) under no program availability during the entire follow-up, (ii) under immediate program availability at initial eligibility, but non-enrollment during the entire follow-up, and (iii) under immediate program availability and enrollment at initial eligibility. We further estimated the controlled direct effect of immediate program availability compared to no program availability, under a hypothetical intervention to prevent individual enrollment in the program. Targeted minimum loss-based estimation was used to estimate the mean outcome, while Super Learning was implemented to estimate the required nuisance parameters. Analyses were conducted with the ltmle R package; analysis code is available at an online repository as an R package. Results showed that at 450 days, the probability of in-care survival for subjects with immediate availability and enrollment was 0.93 (95% CI: 0.91, 0.95) and 0.87 (95% CI: 0.86, 0.87) for subjects with immediate availability never enrolling. For subjects without LREC availability, it was 0.91 (95% CI: 0.90, 0.92). Immediate program availability without individual enrollment, compared to no program availability, was estimated to slightly albeit significantly decrease survival by 4% (95% CI 0.03,0.06, 0.01). Immediately availability and enrollment resulted in a 7% higher in-care survival compared to immediate availability with non-enrollment after 450 days (95% CI-0.08,-0.05, 0.01). The results are consistent with a fairly small impact of both availability and enrollment in the LREC program on in-care survival.

Original languageEnglish (US)
Pages (from-to)69-91
Number of pages23
JournalEpidemiologic Methods
Volume5
Issue number1
DOIs
StatePublished - Dec 1 2016

Fingerprint

Express
Availability
Learning
HIV
Eastern Africa
Triage
Kenya
Lost to Follow-Up
Population
Nurses
Survival
Entire
Direct Effect
Nuisance Parameter
Estimate
Repository
Immediately
Therapeutics
Decrease
Interval

Keywords

  • causal estimation
  • causal inference
  • causal road map
  • semiparametric models
  • targeted learning

ASJC Scopus subject areas

  • Epidemiology
  • Applied Mathematics

Cite this

Evaluating the Impact of a HIV Low-Risk Express Care Task-Shifting Program : A Case Study of the Targeted Learning Roadmap. / Tran, Linh; Yiannoutsos, Constantin; Musick, Beverly S.; Wools-Kaloustian, Kara; Siika, Abraham; Kimaiyo, Sylvester; Van Der Laan, Mark J.; Petersen, Maya.

In: Epidemiologic Methods, Vol. 5, No. 1, 01.12.2016, p. 69-91.

Research output: Contribution to journalArticle

Tran, Linh ; Yiannoutsos, Constantin ; Musick, Beverly S. ; Wools-Kaloustian, Kara ; Siika, Abraham ; Kimaiyo, Sylvester ; Van Der Laan, Mark J. ; Petersen, Maya. / Evaluating the Impact of a HIV Low-Risk Express Care Task-Shifting Program : A Case Study of the Targeted Learning Roadmap. In: Epidemiologic Methods. 2016 ; Vol. 5, No. 1. pp. 69-91.
@article{d9ecf64fb3c34c6bb5086574fc4ee35e,
title = "Evaluating the Impact of a HIV Low-Risk Express Care Task-Shifting Program: A Case Study of the Targeted Learning Roadmap",
abstract = "In conducting studies on an exposure of interest, a systematic roadmap should be applied for translating causal questions into statistical analyses and interpreting the results. In this paper we describe an application of one such roadmap applied to estimating the joint effect of both time to availability of a nurse-based triage system (low risk express care (LREC)) and individual enrollment in the program among HIV patients in East Africa. Our study population is comprised of 16,513 subjects found eligible for this task-shifting program within 15 clinics in Kenya between 2006 and 2009, with each clinic starting the LREC program between 2007 and 2008. After discretizing follow-up into 90-day time intervals, we targeted the population mean counterfactual outcome (i. e. counterfactual probability of either dying or being lost to follow up) at up to 450 days after initial LREC eligibility under three fixed treatment interventions. These were (i) under no program availability during the entire follow-up, (ii) under immediate program availability at initial eligibility, but non-enrollment during the entire follow-up, and (iii) under immediate program availability and enrollment at initial eligibility. We further estimated the controlled direct effect of immediate program availability compared to no program availability, under a hypothetical intervention to prevent individual enrollment in the program. Targeted minimum loss-based estimation was used to estimate the mean outcome, while Super Learning was implemented to estimate the required nuisance parameters. Analyses were conducted with the ltmle R package; analysis code is available at an online repository as an R package. Results showed that at 450 days, the probability of in-care survival for subjects with immediate availability and enrollment was 0.93 (95{\%} CI: 0.91, 0.95) and 0.87 (95{\%} CI: 0.86, 0.87) for subjects with immediate availability never enrolling. For subjects without LREC availability, it was 0.91 (95{\%} CI: 0.90, 0.92). Immediate program availability without individual enrollment, compared to no program availability, was estimated to slightly albeit significantly decrease survival by 4{\%} (95{\%} CI 0.03,0.06, 0.01). Immediately availability and enrollment resulted in a 7{\%} higher in-care survival compared to immediate availability with non-enrollment after 450 days (95{\%} CI-0.08,-0.05, 0.01). The results are consistent with a fairly small impact of both availability and enrollment in the LREC program on in-care survival.",
keywords = "causal estimation, causal inference, causal road map, semiparametric models, targeted learning",
author = "Linh Tran and Constantin Yiannoutsos and Musick, {Beverly S.} and Kara Wools-Kaloustian and Abraham Siika and Sylvester Kimaiyo and {Van Der Laan}, {Mark J.} and Maya Petersen",
year = "2016",
month = "12",
day = "1",
doi = "10.1515/em-2016-0004",
language = "English (US)",
volume = "5",
pages = "69--91",
journal = "Epidemiologic Methods",
issn = "2194-9263",
publisher = "Walter De Gruyter",
number = "1",

}

TY - JOUR

T1 - Evaluating the Impact of a HIV Low-Risk Express Care Task-Shifting Program

T2 - A Case Study of the Targeted Learning Roadmap

AU - Tran, Linh

AU - Yiannoutsos, Constantin

AU - Musick, Beverly S.

AU - Wools-Kaloustian, Kara

AU - Siika, Abraham

AU - Kimaiyo, Sylvester

AU - Van Der Laan, Mark J.

AU - Petersen, Maya

PY - 2016/12/1

Y1 - 2016/12/1

N2 - In conducting studies on an exposure of interest, a systematic roadmap should be applied for translating causal questions into statistical analyses and interpreting the results. In this paper we describe an application of one such roadmap applied to estimating the joint effect of both time to availability of a nurse-based triage system (low risk express care (LREC)) and individual enrollment in the program among HIV patients in East Africa. Our study population is comprised of 16,513 subjects found eligible for this task-shifting program within 15 clinics in Kenya between 2006 and 2009, with each clinic starting the LREC program between 2007 and 2008. After discretizing follow-up into 90-day time intervals, we targeted the population mean counterfactual outcome (i. e. counterfactual probability of either dying or being lost to follow up) at up to 450 days after initial LREC eligibility under three fixed treatment interventions. These were (i) under no program availability during the entire follow-up, (ii) under immediate program availability at initial eligibility, but non-enrollment during the entire follow-up, and (iii) under immediate program availability and enrollment at initial eligibility. We further estimated the controlled direct effect of immediate program availability compared to no program availability, under a hypothetical intervention to prevent individual enrollment in the program. Targeted minimum loss-based estimation was used to estimate the mean outcome, while Super Learning was implemented to estimate the required nuisance parameters. Analyses were conducted with the ltmle R package; analysis code is available at an online repository as an R package. Results showed that at 450 days, the probability of in-care survival for subjects with immediate availability and enrollment was 0.93 (95% CI: 0.91, 0.95) and 0.87 (95% CI: 0.86, 0.87) for subjects with immediate availability never enrolling. For subjects without LREC availability, it was 0.91 (95% CI: 0.90, 0.92). Immediate program availability without individual enrollment, compared to no program availability, was estimated to slightly albeit significantly decrease survival by 4% (95% CI 0.03,0.06, 0.01). Immediately availability and enrollment resulted in a 7% higher in-care survival compared to immediate availability with non-enrollment after 450 days (95% CI-0.08,-0.05, 0.01). The results are consistent with a fairly small impact of both availability and enrollment in the LREC program on in-care survival.

AB - In conducting studies on an exposure of interest, a systematic roadmap should be applied for translating causal questions into statistical analyses and interpreting the results. In this paper we describe an application of one such roadmap applied to estimating the joint effect of both time to availability of a nurse-based triage system (low risk express care (LREC)) and individual enrollment in the program among HIV patients in East Africa. Our study population is comprised of 16,513 subjects found eligible for this task-shifting program within 15 clinics in Kenya between 2006 and 2009, with each clinic starting the LREC program between 2007 and 2008. After discretizing follow-up into 90-day time intervals, we targeted the population mean counterfactual outcome (i. e. counterfactual probability of either dying or being lost to follow up) at up to 450 days after initial LREC eligibility under three fixed treatment interventions. These were (i) under no program availability during the entire follow-up, (ii) under immediate program availability at initial eligibility, but non-enrollment during the entire follow-up, and (iii) under immediate program availability and enrollment at initial eligibility. We further estimated the controlled direct effect of immediate program availability compared to no program availability, under a hypothetical intervention to prevent individual enrollment in the program. Targeted minimum loss-based estimation was used to estimate the mean outcome, while Super Learning was implemented to estimate the required nuisance parameters. Analyses were conducted with the ltmle R package; analysis code is available at an online repository as an R package. Results showed that at 450 days, the probability of in-care survival for subjects with immediate availability and enrollment was 0.93 (95% CI: 0.91, 0.95) and 0.87 (95% CI: 0.86, 0.87) for subjects with immediate availability never enrolling. For subjects without LREC availability, it was 0.91 (95% CI: 0.90, 0.92). Immediate program availability without individual enrollment, compared to no program availability, was estimated to slightly albeit significantly decrease survival by 4% (95% CI 0.03,0.06, 0.01). Immediately availability and enrollment resulted in a 7% higher in-care survival compared to immediate availability with non-enrollment after 450 days (95% CI-0.08,-0.05, 0.01). The results are consistent with a fairly small impact of both availability and enrollment in the LREC program on in-care survival.

KW - causal estimation

KW - causal inference

KW - causal road map

KW - semiparametric models

KW - targeted learning

UR - http://www.scopus.com/inward/record.url?scp=85045444509&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045444509&partnerID=8YFLogxK

U2 - 10.1515/em-2016-0004

DO - 10.1515/em-2016-0004

M3 - Article

AN - SCOPUS:85045444509

VL - 5

SP - 69

EP - 91

JO - Epidemiologic Methods

JF - Epidemiologic Methods

SN - 2194-9263

IS - 1

ER -